FEBRUARY 


— Ss i 
VOLUME 19 
NUMBER 1 


JOURNAL OF 
CONSULTING 
PSYCHOLOGY 








PPT TS Se 


\A | 
PSYCHOLOGY 
le Bg 


February, 1955 Vol. 19, No. 


Contents 


An Objective Comparison of Rogerian and Psychoanalytic Techniques: Hans H. Strupp 
Direction of Perceived Movement in Males and Females: Walter James Gleason - 
Ambiguity as a Therapeutic Variable: Edward S. Bordin 


Differences Between Verbal and Performance IQ’s with Mentally Defective Children on 
the Wechsler Intelligence Scale for Children: J. Robert Newman and Frank M. Loos 


A Systematic Approach to the Construction of Hypotheses About the Process of Psycho- 
therapy: Jum C. Nunnally- - - - - - - - = - = - - 


Alienation, Social Apperception, and Ego Structure: Anthony Davids 


Relationships Between the Rosenzweig P-F Study and Test Duration, Socioeconomic 
Status, and Religion: Edward T. Parsons - - - - - - - = - = = = = = = 


Organizational Activity on the Rorschach Test: Boyd D. Sisson and Earl S. Taulbee 


Psychiatric Screening of Flying Personnel with the Cornell Word Form: John R. Barry, 
Saul B. Sells, and David K.Trites - - - - - +--+ -+-+++-2+-e+e+e- 


Threshold for the Perception of Human Movement in Inkblots: Frank Barron - 


Factors of Change in Lobotomized Chronic Schizophrenic Patients: Maurice Lorr, James 
Q. Holsopple, Richard L. Jenkins, and James P.O’Comnor - - - - - - - 


Rorschach Determinant Shift Among Hallucinatory and Delusional Patients: Robert G. 
Gibby, Bernard A. Stotsky, Robert L. Harrington, and Richard W. Thomas 


Changes in Wechsler Subtest Scores with Age: Robert J. Howell - - 


Davis-Eells (“Culture-Fair”) Test Performance of Lower-Class Retarded Children: Sidney 
Rosenblum, James E. Keller, and Ned Papania - - - - - - - - = - = = 


A Sexual Deviation Scale for the MMPI: James T. Marsh, Jessamine Hilliard, and Robert 
eS oe th) Lig Meek Wiese Ue re ee ge 


The Relationship of the Wechsler-Bellevue Verbal Scale and the — Matrices 
Test: Mahesh M. Desai - - - - - - - - “a iy te la ~ ‘ 


The Relationships Among Five MMPI “Anxiety” Indices: Charles Windle - 
Personality Correlates of Certain Religious Attitudes: William E. Broen, Jr. - - 


The Use of Demographic Characteristics in Predicting Response to Hospitalization for 
Tuberculosis: Louis J. Moran, George W. Fairweather, Robert B. Morton, and Laurence 
EE SE As ee = oS e ic a wo 


Results of Treatment of Enuresis by a Conditioned Response Method: Barclay Martin and 
ee ee a a 


MMPI Responses of Patients with Multiple Sclerosis: Franklin C. Shontz - 
New Meuks Gnd Tests “= 2°~ 2) Se ees ew et el el te lw wl 








Brief Reports: 


A New Publication Procedure 


For a trial period, the Journal of Consult- 
ing Psychology will accept “brief reports” for 
early publication without expense to the au- 
thor, under certain conditions. The new pro- 
cedure is intended to reduce publication lag 
and permit the circulation of worth-while 
studies of specialized interest or minor im- 
portance which cannot be accepted at present 
because of limitations of space. 

A brief report, strictly limited to one printed 
page, may be accepted if the author agrees to 
make a more extended report available. Up to 
four pages in each issue may be devoted to 
brief reports, published in the order of their 
receipt without regard to the dates of receipt 
of articles accepted for regular publication. It 
is anticipated that most of the brief reports 
can appear in the first or second issue to go 
to press following their acceptance. 

The procedure for submitting a brief re- 
port is: 

1. The author sends the editor doth the 
brief report and a more complete report of the 
study. The full report should be of sufficient 
length to give a clear account of the back- 
ground, procedure, results, and conclusions of 
the study. 

2. The full report is prepared in the style 
specified by the Publication Manual (1), ex- 
cept that it may be typed with single spacing. 
The editor will send the full report to the 
ADI. 

3. The brief report gives a clear, condensed 
summary of the procedure of the study, and 
as full an account of the results as space per- 
mits. To insure that the brief report does not 
exceed one printed page, the author prepares 
it according to these specifications: 


The text of the brief report, including all 
matter except the title and the author’s lines, 
does not exceed 80 typewritten lines averaging 
42 characters and spaces in length. Set the 
typewriter margins for short lines of 42 char- 
acters, which are 3.5 inches long in elite typ- 
ing, or 4.2 inches long in pica. The manuscript 
is double spaced throughout and, except for 
the short lines, follows the standard style (1). 

Headings, tables, and references are avoided 
in the brief report. If essential, they must be 
counted in the 80 lines. The brief report in- 
cludes, within its 80 lines, a footnote in this 
style: * 


1An extended report of this study may be ob- 
tained without charge from John Doe, 300 Market 
St., Prospect 6, Mass. [giving the author’s full name 
and address] or for a fee from the American Docu- 
mentation Institute. To obtain it from the latter 
source, order Document No. .... from ADI Auxiliary 
Publications Project, Photoduplication Service, Li- 
brary of Congress, Washington 25, D. C., remitting 
in advance $ for microfilm or $........ for photo- 
copies. Make checks payable to Chief, Photodupli- 
cation Service, Library of Congress. 


4. The author of a brief report prepares at 
least 100 mimeographed copies of the extended 
report. He agrees: (a) to send copies of the 
extended report upon request as long as the 
supply lasts, and (6) not to submit the ex- 
tended report for publication to another 
printed journal of general circulation. 
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1. American Psychological Association. Council of 
Editors. Publication manual of the American 
Psychological Association. Psychol. Bull., 1952, 
49, 389-449. 
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An Objective Comparison of Rogerian and 
Psychoanalytic Techniques’ 


Hans H. Strupp * 
Washington, D. C. 


The research effort by Carl Rogers and his 
students to describe and elucidate the process 
of nondirective counseling has provided ob- 
jective evidence in an area in which such 
evidence has been sorely lacking. Unfortu- 
nately, this impetus has not extended to other 
theories of psychotherapy, particularly those 
based more explicitly upon psychoanalytic 
principles, which today claim a numerically 
much larger following. The result of this 
development is a reasonably well-documented 
body of knowledge concerning client-centered 
counseling but almost a total absence of em- 
pirical data on psychoanalytically oriented 
therapy (cf. Saslow’s recent review [7]). 

It is not surprising that much of the pub- 
lished research has focused upon the results 
of treatment and upon the development of 
methodologies for the description of the inter- 
personal process of therapy. It was also in- 
evitable that the patient, for whose benefit 
the treatment is conducted, would receive a 
fair share of attention from investigators; it is 
less apparent why so little research effort has 
been expended upon the psychotherapist. Yet, 
it is almost axiomatic that the therapist’s per- 


1This article is one in a series of investigations 
concerned with the objective study of psychothera- 
pists’ verbal operations. It represents one phase of 
the author’s doctoral dissertation submitted to the 
Graduate Council of the George Washington Uni- 
versity (10), and was in substance presented at the 
1954 meeting of the Eastern Psychological Associa- 
tion in New York. Grateful acknowledgment is 
made to Professor Curtis E. Tuthill, Dr. E. Lakin 
Phillips, and Leon Salzman, M.D., for valuable sug- 
gestions and criticisms. 

2 While carrying out this work, the author held 
positions successively with the Department of the 
Air Force and the Department of the Army. Neither 
organization has any connection with this research. 


sonality and attitudes are the prime determin- 
ers of the character of his therapeutic opera- 
tions. On the nondirective side, several in- 
vestigators have given attention to the thera- 
pist’s verbal behavior (e.g., Porter 4, See- 
man 8, Snyder 9, among others), but with 
the exception of a few isolated studies, no 
systematic attempt has been made to study 
the techniques of psychotherapists not sub- 
scribing to the Rogerian frame of reference. 
The work reported by Fiedler (2) in Mowrer’s 
recent compendium represents an important 
beginning, but it must be broadened in scope 
and supplemented by a good deal of down-to- 
earth exploratory research to give us a better 
idea of what is meant by such dimensions as 
“expertness,” “ideal therapeutic relationship,” 
etc. In short, as research into the process of 
psychotherapy increases and as psychotherapy 
acquires the status of a scientific discipline, 
we may expect to see a concomitant rise in 
the number of investigations bearing upon the 
contributions of the psychotherapist to the 
treatment situation. 

In keeping with this orientation, the present 
inquiry attempts an empirical comparison be- 
tween the psychotherapeutic techniques used 
by Rogerian and psychoanalytically oriented 
psychologists. The rationale guiding this work 
may be stated thus: Techniques of psycho- 
therapy are rational and systematic procedures 
designed to produce an amelioration of the 
patient’s mental health. Every communication 
by the therapist is ideally placed in the service 
of the over-all objectives of therapy, as con- 
ceived and elaborated in the prominent the- 
ories. Techniques may therefore be considered 
as theory translated into action. Without get- 
ting embroiled in discussions about the extent 
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to which Rogers’ client-centered theory is 
basically different from psychoanalytic prin- 
ciples, or whether Rogers’ theory is in fact 
nondirective, it is evident that differences in 
emphasis do exist among the major theories 
of psychotherapy. So much is certain. But 
what about theory in action? Do the opera- 
tions of psychotherapists proceed in accord- 
ance with the theoretical precepts to which 
they claim allegiance? If so, we would know 
at least that different theories lead to specific 
therapeutic procedures predictable from the 
theory, although the therapeutic effectiveness 
of any procedure is thereby no further eluci- 
dated. If not, theory would have little practical 
import for therapy. 

Investigations of the techniques of Rogerian 
counselors have shown (e.g., 4, 8,9) that they 
make considerable use of the techniques ad- 
vocated by Rogers, such as reflections of feel- 
ing, nondirective leads, etc. With respect to 
psychoanalytically oriented therapy we have 
few objective data. It is well known, of 
course, that the ultimate emphasis of psycho- 
analytic technique rests upon interpretation, 
especially of the transference situation in the 
broadest sense. However, interpretations are 
not be to made frequently, indiscriminately, 
or at all in the initial phases of therapy (3, 
ch. VIII). What techniques, then, does the 
psychoanalytically oriented therapist use at 
the beginning of therapy when the patient 
has as yet produced little information and the 
therapist is still unclear al ~ut the underlying 
dynamics? By singling om the Rogerian and 
psychoanalytic systems for the present com- 
parison, we hope to provide objective evidence 
on the operational similarities and differences 
of two important theoretical orientations. 

Specifically, followers of Rogers’ system, in 
accordance with the principles enunciated in 
Counseling and Psychotherapy (5) and Client- 
centered Therapy (6), should be distinguish- 
able from non-Rogerian therapists in regard 
to technique in (a) a larger number of “re- 
flective” responses, (6) fewer interpretations, 
(c) fewer exploratory questions, (d) less 
reassurance, (e) fewer instances of passive re- 
jection and outright antagonism. Analytically 
oriented therapists, on the other hand, should 
differ from Rogerians in (a) offering a larger 
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number of interpretations, (6) more explora- 
tions, and (c) fewer reflective responses. 
Finally, it was hypothesized that the varia- 
ble of personal analysis might disclose sys- 
tematic differences in verbal techniques.* 


Method 


To study the therapist’s verbal behavior 
under reasonably standardized conditions it 
was considered advisable to avoid the com- 
plexities of the actual therapeutic situation, 
but rather to have the therapist respond to a 
carefully preselected sample of patient com- 
munications. Thus, a series of 27 short para- 
graphs of patient statements was culled from 
published therapeutic interviews and typed 
on individual cards. A bare minimum of back- 
ground information preceded each statement. 
It was stipulated that the materials pertained 
to early interviews to forestall the possible 
criticism that the interpersonal relationship 
between therapist and patient would make 
it difficult to formulate a response. The 27 
statements were regarded to be a fairly repre- 
sentative cross section of verbalizations typi- 
cally heard from neurotic patients in early 
interviews. Represented in the series were a 
variety of complaints, statements by a seri- 
ously disturbed near-psychotic patient, suicide 
threats, and other transference reactions, such 
as blocking, negativism, requests for direct 
advice, and open hostility. 

Such “miniature therapeutic situations” ob- 
viously introduce a certain degree of arti- 
ficiality and fall short of replicating the actual 
therapeutic session. While the degree of cor- 
respondence between the therapist’s actual 
operations (the criterion) and his perform- 
ance in a “test” situation should eventually 
be explored, we may, for the present, grant a 
certain conditional validity to our experi- 
mental procedure. 


3It should be noted that our concern here is ex- 
clusively with but a limited aspect of the therapeutic 
process—the therapist’s verbal contribution which is 
at no time considered coextensive with his total con- 
tribution to the treatment situation. But since tech- 
niques are described, advocated, taught, and manipu- 
lated, it is a legitimate undertaking to inquire into 
their application and to explore the extent to which 
they are a function of the practitioner’s theoretical 
orientation. 
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Table 1 





The Sample by Experience Level and Personal Analysis 





Personal analysis 


No personal analysis 





Sub- 








Experi- Inex- Experi- Inex- Sub- 
Group enced perienced total enced perienced total Total 
Rogerian psychologists 3 2 5 1 2 3 8 
Psychoanalytically oriented 
psychologists 3 3 6 0 1 1 7 
Total 6 5 11 1 3 4 15 





Procedure and Subjects 


Therapists who had indicated a willingness 
to participate were visited and interviewed in- 
dividually. Cooperation was surprisingly good, 
and very few of the therapists who were ap- 
proached refused. Each interview lasted about 
one and a half to two hours. 

The respondent was presented with the ex- 
perimental series of patient statements and 
requested to state what response, if any, he 
would make to the hypothetical patient. 

Information concerning the therapist’s train- 
ing, experience, theoretical orientation, etc. 
was collected at the end of the session. 

The subjects were 15 psychologists engaged 
in the practice of psychotherapy; 8 were 
Rogerians and 7 were psychoanalytically 
oriented. Practically all respondents were at- 
tached to clinics in the Washington, D. C. 
area, and in addition to psychotherapy per- 
formed diagnostic and related functions. The 
data were supplemented by responses simi- 
larly collected from 25 psychiatrists and 9 
psychiatric social workers, who constituted two 
psychoanalytically oriented reference groups. 

Seven psychologists had more than five 
years of experience in therapy, and will be 
referred to as “experienced therapists.” Table 
1, which presents the respondents’ experience 
level, also indicates that five Rogerians and 
six non-Rogerian psychologists had undergone 
personal analysis as part of their training. 
Rogerians and non-Rogerians appear to be 
well equated as regards experience level and 
personal analysis.‘ 


*A certain degree of heterogeneity must be as- 
sumed among the respondents. There is no “pure” 
Rogerian just as there is no “pure” psychoanalyti- 


Results 


Therapists’ responses were categorized by 
Bales’ system of interaction process analysis 
(1), a well-known general purpose frame- 
work for describing social interactions. This 
system commended itself for present purposes 
because of its theoretical neutrality as re- 
gards the conflicting schools of psychotherapy 
and because of the concentrated effort which 
has gone into the formulations. 

The psychologists’ responses yielded a total 
of 553 score units (mostly simple sentences 
or thought segments). The reliability of the 
categorizations was tested by several methods 
and found to be 78 per cent.° 

Table 2 shows Bales’ 12 categories, to- 
gether with the responses of Rogerians and 
non-Rogerians assigned to each. Figure 1 
presents the same results in profile form. The 
t values (computed by the formula for un- 
correlated percentages) indicate highly statis- 
tically significant differences between Rogerian 


cally oriented therapist. Most Rogerians must have 
come in contact with psychoanalytic concepts, par- 
ticularly those who had undergone per onal psycho- 
analysis. The converse is not necessarily true. Also, 
while there is considerable diversity in psychoana- 
lytic thinking, most therapists surveyed here (in- 
cluding psychiatrists and social workers) had come 
under the influence of the Washington School of 
Psychiatry, and thus espoused neo-Freudian prin- 
ciples and concepts. The classificatory problem was 
resolved by including all psychoanalytically oriented 
therapists in one group and all therapists who ac- 
knowledged Rogerian influences in the other. 

5 Since data were collected from psychiatrists and 
social workers for related projects, the reliability 
was tested upon a stratified random sample of 20 
per cent of the cases. The reliability percentage 
figure represents the average agreement among three 
judges who independently scored 370 response units. 
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and analytically oriented therapists in almost 
all applicable categories. A chi-square test 
for the distributions is significant beyond the 
.001 level of confidence. 

Figures 2 and 3 attempt a comparison be- 
tween experienced and inexperienced thera- 
pists in each of the two groups. Rogerian 
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therapists show a highly significant decline in 
reflective responses (Category 6) with in- 
creasing experience, and a corresponding rise 
in exploratory responses (Category 8). The 
difference in Category 12 appears to be of 
little practical importance. Chi square is again 
highly statistically significant. Differences be- 


Table 2 


Scoring Categories and Response Frequencies 

















Rogerians’ Non-Rogerians’ 
responses responses 
Category Interaction process “‘Psychotherapeutic”’ 
no. analysis definition definitionT N % N % t 
1 Shows solidarity, Gives reassurance, encourage- 8 2.6 13 5.3 1.69 
raises other’s status, ment, shows compassion, 
gives help, reward. tenderness. 
2 Shows tension release, Not applicablet 0 0 0 0 
jokes, laughs, shows 
satisfaction. 
3 Agrees, shows passive Shows passive acceptance, 16 5.2 39 «15.8 4.10** 
acceptance, understands, understanding, is permissive 
concurs, complies. (includes silences). 
4 Gives suggestion, Proposes course of action, 3 1.0 15 6.1 3.46** 
direction, implying defines (“structures”) the 
autonomy for other. therapeutic situation. 
5 Gives opinion, Interprets, analyzes behavior 11 3.6 25 10.0 3.10** 
evaluation, analysis, patterns; thought in process, 
expresses feeling, wish. inferential reasoning. 
6 Gives orientation, Restates, clarifies, 231 = 75.5 35 14.2 14.26** 
information, repeats, “reflects” (Rogerian 
clarifies, confirms. response). 
7 Asks for orientation, Asks factual questions, 0 0 17 6.9 4.60** 
information, repetition, expresses lack of 
confirmation. knowledge, uncertainty. 
8 Asks for opinion, Explores, asks for elabora- 30 9.8 88 35.6 1a7°° 
evaluation, analysis, tion or expression of feeling 
expression of feeling. (includes open-ended ques- 
tions, “‘nondirective leads’”’). 
9 Asks for suggestion, Not applicable} 0 0 0 0 
direction, possible 
ways of action. 
10 Disagrees, shows passive Shows passive rejection, dis- 3 1.0 13 5.3 3.14** 
rejection, formality, belief; ignores requests or 
withholds help. complaints; thwarts, frus- 
trates. 
11 Shows tension, asks for Not applicablet 0 0 0 0 
help, withdraws out of field. 
12 Shows antagonism, deflates Shows antagonism, aggres- + 1.3 2 8 56 
other’s status, defends or __ sion, sarcasm, irony, 
asserts self. cynicism. 
Total 306 100.0 247 100.0 





¢ This column gives examples of the kinds of responses by therapists included in the categories, which were in no way redefined. 


were 


** Significant at the .01 level of confidence. 


t The absence of responses in these categories is probably a function of the experimental conditions under which responses 
ted. 
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tween experienced and inexperienced analyti- 
cally oriented practitioners seem to be due to 
chance. 

The final tabulation (Figure 4) shows con- 


ROGERIANS 
NON- ROGERIANS 


— 


60 
75 
70 


- 


65 
60 
55 
50 
45 
40 
35 
30 


PERCENT 


25 
20 


15 
10 
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Fig. 1. Response distributions of Rogerian and psy- 
choanalytically oriented psychotherapists. 
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Fig. 2. A comparison of the response distributions 


of experienced and inexperienced Rogerian psycho- 
therapists. 
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Fig. 3. A comparison of the response distributions 
of experienced and inexperienced non-Rogerian psy- 
chotherapists. 
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Fig. 4. Response distributions of analyzed and un- 


analyzed Rogerian psychotherapists. 


siderable overlap between Rogerian therapists 
who had been analyzed and those who had 
not. Noteworthy differences are observed in 
Categories 3 and 8: analyzed therapists give 
significantly fewer responses classifiable as 
passive acceptance and explorations. Because 
of the small number of clinicians involved in 
this comparison, the results must be con- 
sidered highly tentative. (Chi square was sig- 
nificant at about the .14 level.) A similar 
comparison for non-Rogerian therapists proved 
unfeasible for the same reason. 








Discussion 

The sharp differences between Rogerian and 
psychoanalytically oriented psychologists con- 
stitute a striking finding, which in general 
confirms the predictions made from theoretical 
expositions. Thus, it is noted that Rogerians 
rely heavily on reflective techniques, with a 
corresponding neglect for other types of re- 
sponses.* Non-Rogerians, while showing a pro- 
nounced predilection for exploratory responses, 
reveal more than minimal frequencies in such 
categories as passive acceptance, structuring, 
interpretation, and possibly reassurance, di- 
rect factual questions, and passive rejection. 
Their responses are distributed more evenly 
over the range of techniques than those of 
the Rogerians and, as was shown in another 
context, closely resemble the response pat- 
terns of psychiatrists and social workers. 
These results, of course, indicate nothing con- 
cerning the relative effe:,tiveness of these tech- 
niques, but regardless @f other considerations 
there is at least the gossibility that undue 
preoccupation with an one technique may 
lead to stereotypy. 

The data presented {rf Figure 2 indicate a 
noteworthy decline of ‘t&sponses in the Ro- 
gerians’ most favored <##egory, which is not 
paralleled by non-Rogefians. An analogous 
difference was observed between experienced 
and inexperienced psyciiatrists. This suggests 
that an increase in professional experience 
leads to a diversification of technique, and 
that, conversely, reliance on one specific tech- 
nique is a characteristic of inexperience. 

The differences between analyzed and un- 
analyzed Rogerian therapists, exhibited in 
Figure 4, while based on a small number of 
cases, are in general agreement with similar 
analyses for psychiatrists, non-Rogerian psy- 
chologists, and social workers. This observa- 
tion applies particularly to the larger number 
of responses categorized as passive acceptance 


6It is interesting to note that the present fre- 
quency of reflective responses (75 per cent) falls 
about midway between two comparable figures re- 
ported for actual therapeutic interviews. Using a 
somewhat different classification scheme, Snyder (9) 
categorized 62.6 per cent of counselor responses as 
“nondirective,”’ whereas Seeman (8) gave a figure of 
85 per cent. 
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(no distinction was made between silent re- 
sponses and other signs of passive acceptance, 
such as “Yes,” “Mmmh,” etc.). The statis- 
tically significant difference in exploratory re- 
sponses was not observed in any other analy- 
ses. While only inadequately explained at this 
time, this finding is of significance here be- 
cause it clearly cuts across the Rogerian—non- 
Rogerian cleavage which these analyses have 
demonstrated. 

The results of this investigation leave little 
doubt that adherence to the Rogerian frame 
of reference is an important determinant of a 
psychotherapist’s techniques, transcending pro- 
fessional affiliation and experience level. Also, 
within the limits imposed by the experimental 
situation, psychoanalytically oriented psychol- 
ogists, psychiatrists, and social workers form 
a rather homogeneous group with respect to 
their therapeutic operations. Future investiga- 
tions must refine these analyses and specify 
the conditions under which a given technique 
achieves a particular therapeutic effect. 


Summary 


As one in a series of investigations to elu- 
cidate the psychotherapist’s contribution to 
the treatment situation, the present study at- 
tempts a systematic comparison between the 
techniques used by Rogerian and psychoana- 
lytically oriented psychologists in early thera- 
peutic interviews. Therapeutic responses were 
secured from eight Rogerian and seven non- 
Rogerian psychologists to a series of 27 pa- 
tient statements which had been extracted 
from actual therapeutic interviews. A total of 
553 response units was categorized by Bales’ 
system of interaction process analysis. Aver- 
age rater agreement was determined to be 78 
per cent. The major results may be sum- 
marized as follows: 

1. Sharp differences exist between the re- 
sponse patterns of Rogerian and non-Rogerian 
therapists. As might be expected, Rogerians 
show a strong predilection for reflective re- 
sponses, with a concomitant lack of responses 
in all other categories. Psychoanalytically 
oriented psychologists distribute their re- 
sponses more evenly over a variety of tech- 
niques although they prefer explorations at 
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this stage of therapy. The latter group agrees 
closely with psychiatrists and social workers 
whose techniques were investigated in related 
projects. 

2. Rogerians disclose a significant decline 
in reflective responses as the level of their 
professional experience increases. While non- 
Rogerian psychologists fail to show a com- 
parable trend, there is other evidence that an 
increase in experience leads to a diversification 
of therapeutic technique. Exclusive reliance 
on one technique appears to be a correlate of 
inexperience. 

3. Analyzed Rogerians, like other therapists 
whose training has included personal analysis, 
show significantly fewer silent responses (pas- 
sive acceptance). 

This study thus provides preliminary ob- 
jective evidence on the techniques of psycho- 
therapists (psychologists) who are follow- 
ing respectively Rogerian and psychoanalytic 
principles, and documents pronounced differ- 
ences in therapeutic technique specifically at- 
tributable to the clinician’s theoretical view- 
point. 


Received May 10, 1954. 
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Direction of Perceived Movement in Males 
and Females’ 


Walter James Gleason 
Mental Hygiene Consultation Service, Fort Knox, Kentucky 


Rorschach notes a quality of movement on 
the inkblots which he calls flexion or exten- 
sion. He states that subjects who see exten- 
sion movements are active individuals with 
strong drive toward self-assertion. Those who 
see flexion movements are thought to be pas- 
sive, resigned, neurasthenic individuals. Ror- 
schach also quotes Oberholzer as writing that 
flexion movements in a man represent the 
feminine part of his sexuality. 

Beck has elaborated on this notion and also 
defines flexion and extension movements more 
precisely. He defines the extension M as cen- 
trifugal, as a pull away from the center. Beck 
calls the flexion M centripetal, a pull toward 
the center. He seems to agree essentially with 
the Oberholzer concept of extensor and flexor 
M representing respectively the masculine and 
feminine attitude in the basic personality 
structure. Thus Beck states that the stance 
in the fantasy activity may provide evidence 
supporting the homosexual lead. 

To check on the extensions made by Beck 
and Oberholzer, a series of 28 plates was con- 
structed with the intent to produce figures in 
which either centrifugal or centripetal move- 
ment could be perceived with equal ease. 
These plates administered to male and fe- 


1An extended report of this study may be ob- 
tained without charge from Lt. Walter Gleason, 
140-F Prichard Pl., Fort Knox, Kentucky, or for a 
fee from the American Documentation Institute. To 
obtain it from the latter source, order Document 
No. 4454 from ADI Auxiliary Publications Project, 
Photoduplication Service, Library of Congress, Wash- 
ington 25, D. C., remitting in advance $1.25 for 
microfilm or $1.25 for photocopies. Make checks pay- 
able to Chief, Photoduplication Service, Library of 
Congress. 


male populations could then be used to test 
whether males would show a predominance 
of centrifugal movements, and the females, a 
predominance of centripetal movements. Cen- 
trifugal movement was defined as movement 
away from the geographical center of the 
plate field, while centripetal movement was 
defined as either movement toward the center 
of the plate field or that remained within the 
center of the field. Many of the designs were 
suggested by actual Rorschach movement 
stances, while the remainder were more ab- 
stract figures such as contracting-expanding 
splashes, cubes, circles, and the like. 

The plates were made into slides for group 
administration and an answer sheet was con- 
structed so that upon viewing each plate, S 
was forced into a selection of one of two re- 
sponses, one representing a centrifugal direc- 
tion of movement, and the other representing 
a centripetal direction of movement. The Ss 
included 101 males and 87 females from in- 
troductory psychology classes at the Univer- 
sity of Maryland. 

Chi-square analysis revealed that in no case 
did the male group exhibit a significantly 
greater number of centrifugal movement re- 
sponses than the female group. On only two 
plates were results approaching significance 
noted. Neither favored the Oberholzer-Beck 
hypothesis. Thus the fact of biological sexu- 
ality has no bearing on the perception of di- 
rection of movement on these plates. If the 
Oberholzer-Beck hypothesis is true, it would 
seem that more elements are involved than 
mere direction of movement. 
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Ambiguity as a Therapeutic Variable 


Edward S. Bordin 


University of Michigan 


One of the major issues in psychotherapy 
is the answer to the question of what makes 
an interpersonal relationship therapeutic in 
the sense that the relationship leads to sig- 
nificant personality changes. In an earlier 
article (3) I have presented and discussed the 
hypothesis that therapeutic relationships vary 
in more than one significant dimension. Now 
I shall pursue this point further. 

Before we can proceed, it is necessary to 
distinguish psychotherapy * from what might 
be called therapeutic phenomena. Many inter- 
personal relationships which occur in other 
than a formal therapeutic setting result in 
personality changes. Interactions with friends, 
teachers, and others can result in considerable 
modification of the affective and motivational 
aspects of behavior patterns. However, these 
changes have not resulted from the planned 
and controlled use of these interpersonal re- 
lationships. Changes resulting under condi- 
tions of ordinary interpersonal relationships 
can be called therapeutic phenomena to dis- 
tinguish them from psychotherapy where one 
person, the therapist, makes use of interper- 
sonal relationships in a conscious and con- 
trolled way to lead to changes in the other 
person’s personality. Therapeutic phenomena 
may be thought of as resulting from the co- 
incidence that one person’s natural ways of 
reacting correspond with the kinds of reac- 
tions from people which will lead to personal- 
ity change in another person. The problem in 
the theory and practice of psychotherapy is 
to identify those characteristics of interper- 


1 For purposes of this discussion the term “psycho- 
therapy” should be read to refer to all types of 
situations where personality modification is the goal, 
i., counseling, short-term therapy, and intensive 
therapy. The respective pairs of terms, “therapist” 
and “counselor,” and “patient” and “client,” will be 
used interchangeably within the pairs. 


sonal relationships which can make relation- 
ships therapeutic. 

A multidimensional conception of -thera- 
peutic relationships is not universally ac- 
cepted. As my earlier paper suggested, Ro- 
gerian theory (11) seems to have assumed 
that there is a single characteristic of inter- 
personal relationships, namely, nondirective- 
ness or permissiveness, which can account for 
the therapeutic value of these relationships for 
all combinations of patient and therapist per- 
sonality. As a matter of fact the directive- 
nondirective dimension of therapeutic rela- 
tionships has never, to my knowledge, been 
subjected to the type of analysis which would 
permit a test of the tenability of the unidimen- 
sional assumption. Aside from this factual 
issue, it would appear that an assumption of 
unidimensionality of therapeutic relationships 
would seem to stem from a relatively simplified 
conception of personality structure and per- 
sonality change. This is an assumption which 
many will be unwilling to accept. If one 
accepts the proposition that personalities, 
whether of patient or of therapist, must be 
analyzed along multiple dimensions in order 
to be understood and that these dimensions 
will be relevant to personality development 
and change, then a quest for multidimensional 
characteristics of therapeutic relationships is 
indicated.” 

Several possible dimensions which might be 
relevant to the therapeutic value of relation- 
ships were suggested in the earlier paper. 
Since that time, more intensive theoretical 


2 This position does not preclude the possibility 
that the distinction between directive and nondirec- 
tive relationships refers to a particular combination 
of independent subcharacteristics. We still would 
want to study all of the combinations of character- 
istics and their contribution to the therapeutic char- 
acter of interpersonal relationships. 
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analysis accompanied by considerable direct ob- 
servation of therapeutic relationships through 
the medium of recordings, typescripts, and 
supervisory interviews has led to drastic mod- 
ification of these first tentative statements.* 
The purpose of this paper will be to present 
a theoretical analysis of one hypothesized di- 
mension, namely, ambiguity. Future papers 
will present others of the dimensions being 
formulated.‘ 


The Concept of Ambiguity 


Ambiguity refers to the stimulus charac- 
teristics of the therapeutic situation, of which 
the therapist is the most significant part. As 
two people interact, each defines himself to 
the other as a stimulus object to a greater or 
lesser degree. As a therapist interacts with a 
patient, he defines himself and the situation 
both directly, i.e., by direct statement, and, 
most frequently, indirectly, by the total im- 
port of his actions. It is possible to conceive 
of three especially relevant areas in which 
these definitions can take place: (a) the 
topics it is appropriate to discuss with him; 
(6) the closeness and other characteristics of 
the relationship expected; (c) the therapist’s 
values, in terms of the goals that he assumes 
he and the patient should work toward, as 
well as in more general terms. The therapist 
may define with different degrees of clarity 
these three aspects of himself and the thera- 
peutic task. He may define one or two of 
them quite clearly and leave the others vague 
or he may vary the three in different combina- 
tions and degrees. 


3] am indebted to the Rackham Fund of the 
Graduate School, University of Michigan, for making 
possible the collection of interview protocols which 
facilitated the process of analysis. 

4A research grant, M-516, from the National In- 
stitute of Mental Health of the National Institutes 
of Health, U. S. Public Health Service, is making 
possible an active program of empirical exploration 
of therapeutic interactions. Drs. A. T. Dittmann 
(now with NIMH) and H. Raush are coparticipants 
as principal investigators. Dr. N. I. Harway is re- 
search coordinator. Other participants, past and 
present, include Dr. R. L. Cutler, D. Rigler, and 
Z. Sperber. All have contributed to the ideas in 
this paper to some degree; however, the responsi- 
bility for this statement is mine. Many of the addi- 
tional dimensions being formulated are the specific 
contributions of my colleagues, Drs. Dittmann and 
Raush. 


By way of topic the therapist may com- 
municate to the patient that he is supposed 
to talk about his dreams, his job, or his 
sexual relationships. The area of choice of 
topic may be even more restrictively defined, 
e.g., the patient’s relationships with his boss, 
the courses he will be taking next year, or it 
may be left more ambiguous, e.g., anything 
that is of personal concern to the patient. The 
analytic rule “tell me anything that comes to 
your mind” represents one of the least re- 
strictive and therefore most ambiguous defi- 
nitions of the appropriate topics for discus- 
sion. 

The therapist’s definition of the closeness 
of the relationship is undoubtedly influenced 
by the content of his definitions of appropri- 
ate topics. It is customary, in introducing the 
analytic rule, to talk about the therapeutic 
situation as different from and not subject to 
the usual inhibitions associated with ordinary 
social intercourse. When a therapist indicates 
that he expects the patient to talk about very 
personal feelings he implies that it will be a 
very personal relationship. However, many 
other aspects of the therapist’s behavior are 
probably more important than formal “struc- 
turing” in defining the expected character- 
istics of the relationship, e.g., the counselor 
who addresses his client by his first name on 
first meeting is suggesting an adult-child or 
fatherly relationship. Whether the therapist 
permits himself to exchange feelings with the 
patient or maintains an emotionally controlled 
objective distance is influential in conveying 
therapist definitions of the relationship. Simi- 
larly, the therapist may be quite communica- 
tive of his values or leave them relatively un- 
defined. 

The patient reacts to all three aspects of 
the situation simultaneousiy. All three as- 
pects are dynamically interrelated parts of 
an organic whole. Therefore, the effect is to 
create situations that vary in the degree to 
which the stimulus field determines the re- 
sponse. In more ambiguous situations dif- 
ferent patients will react in different ways. 
Some will see the therapist as demanding 
and critical, others will see him as aloof and 
disinterested, etc. In less ambiguous situa- 
tions patients will tend to agree more in 
their perceptions. This last statement must 
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be qualified by considerations of patient per- 
sonality factors which will be discussed in 
the next section. 

In effect, we are talking about the degree 
to which the therapist either advertently or 
inadvertently gives structure to the stimulus 
field for the patient. The analyst as a blank 
screen appears to represent an example of 
one extreme of the ambiguity-structuredness 
dimension. Through long periods of silence 
the analyst minimizes the amount of struc- 
ture the situation presents to the patient. 
His admonition “tell me whatever comes to 
your mind” gives the patient little material 
for a perception of specific appropriate con- 
tent for communication. The analyst’s po- 
sition behind the patient eliminates or mini- 
mizes the possibility of the patient’s obtain- 
ing structuring cues from facial expressions 
or other fragmentary movements. Informa- 
tion-bound counseling relationships, on the 
other hand, are good examples of extremely 
structured situations where the purposes of 
the meeting and the goals are usually both 
explicitly and implicitly defined in relatively 
definite terms and where the topic is often 
restricted by a series of very delimited ques- 
tions which can be answered “yes” or “no.” 

To summarize, ambiguity in the context 
of psychotherapy refers to a quality of the 
stimulus characteristics of the therapist and 
the therapeutic task. Ideally, the discrimi- 
nation of degrees of ambiguity would be 
based upon the variability of responses 
among people to a given stimulus complex. 
Until now, no practical way of applying this 
direct approach to the measurement of am- 
biguity in psychotherapy has been devel- 
oped. However, Osburn (10) did establish 
two reliable methods of measurement, one 
based upon ratings of sections of therapeutic 
interactions ranging in size from a_ type- 
script page to an interview unit, the other 
based on coding of discrete categories of be- 
havior, each category weighted and then all 
combined to yield a score. These two meth- 
ods of measurement were found to yield 
correlations with each other approximately 
equal to their reliabilities. Further, Osburn 
presented evidence to support the hypothe- 
sis that ambiguity is a unidimensional char- 
acteristic of therapeutic interviews. Although 


Osburn found that ambiguity seemed to op- 
erate as a single scale, he also found that his 
raters were able to make discriminations 
only in ordinal terms. The reliability of Os- 
burn’s coding method of measurement was 
confirmed as a by-product of Dibner’s (5) 
study of the relationship of anxiety to am- 
biguity to be discussed later. 


Relation to Personality Theory 
and Measurement 


Ambiguity as a variable in personality 
theory, particularly in connection with emo- 
tional factors in perception, is already well 
known. Ambiguity is achieved by tachisto- 
scopic exposure of stimuli at speeds which 
provide decreased visual clarity. The varia- 
tions in perceptions obtained under those 
conditions are taken as reflections of or- 
ganized systems of motivations, emotions, 
and defenses (2, 4). 

Similarly, ambiguity as a factor in per- 
sonality measurement is already utilized in 
the basic theory of projective techniques.’ 
Projective tests have two characteristics. 
First, they require that the subject react to 
stimuli which do not have demanding struc- 
tural determinants of perception. Second, 
projective tests make possible the identifi- 
cation of the dimension of the stimulus to 
which the individual has responded and the 
content of his response. Knowing these it is 
possible to make inferences about the mo- 
tivational and emotional structure of the in- 
dividual or, in usual terms, his personality 
structure. For a long period enthusiasm for 
the projective hypothesis has led merely to 
a multiplication of types of projective situa- 
tions. More recently there have been poten- 
tially more productive studies designed to 
amplify the projective hypothesis as it ap- 
plies to personality assessment. One of the 
natural objects of study is the degree of am- 
biguity in any test situation. It seems to me 
that we can learn more by experimental 
variations within a projective test situation 
than from an unending process of devising 
new tests. Weisskopf-Joelson (13, 14, 15) 
has illustrated this experimental design by 
her studies of the effects of various degrees 


5 For example, see Abt and Bellak (1, pp. 12-18). 
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of clarity of the human figures on produc- 
tivity in the TAT. Miller and his students 
(9) have demonstrated that a projective 
test must be studied not only in terms of 
the test stimuli but as a total situation. 
They have found that such factors as the 
personality of the examiner and the types 
of task definitions given the subject, e.g., 
“this is a test of intelligence,” or “this is a 
test of imagination,” influence Rorschach re- 
sults. 

Frenkel-Brunswik (7) has placed particu- 
lar emphasis on tolerance for ambiguity as an 
emotional and perceptual personality variable. 
She has interrelated intolerance of cognitive 
ambiguity with emotional ambivalence and 
rigidity. Her analysis is supported by the re- 
sults of studies carried on by her and her col- 
laborators in the areas of ethnic prejudice, 
perceptual ambiguity, and rigidity in prob- 
lem solving. 


The Concept of Ambiguity in 
Therapeutic Theory 


Of all therapeutic theories, Freudian theory 
makes the most complete and the most ex- 
plicit use of ambiguity. As has been indicated 
above, the Freudian emphasis on the thera- 
pist as a blank screen is a clear description 
of the therapist presenting himself and the 
situation as an ambiguous stimulus object. 
In his discussions of therapeutic technique, 
Fenichel (6) dealt rather directly with the 
relationship between ambiguity and the effec- 
tiveness of transference interpretation. Al- 
though he does not use the term ambiguity, 
he does point out that transference interpreta- 
tion will be ineffective and noncommunicative 
when the therapist has acted in a manner 
consistent with the patient’s transference-de- 
termined perceptions of him. He suggests, 
further, that a therapist cannot be certain 
that transference reactions are in fact being 
manifested if he does not eliminate the re- 
ality basis for the patient’s reaction. Only 
thus can he demonstrate to himself as well as 
to the patient that the patient’s reactions to 
him are controlled by irrational, infantile 
feelings. 

When we turn to nondirective theory, we 
find that being “nondirective” means, in part, 
not defining or imposing your own values on 


the client. Also, the nondirective counselor is 
supposed to avoid “directive” leads. A direc- 
tive lead seems to be a demand for the client 
to talk about a very specific topic in restricted 
terms as contrasted with a nondirective lead 
which is a more general invitation to com- 
municate, sometimes including a relatively 
unrestricted designation of a topic. One gets 
the impression that Rogerian therapists are 
much less ambiguous than orthodox analytic 
therapists. This impression is based on the 
fact that Rogerian therapists seem to talk 
more, particularly in the early stages of thera- 
peutic relationships. It is relatively rare for 
the Rogerian therapist to respond with silence 
to a patient’s responses. It seems as though 
the Rogerian goal of understanding the client 
or patient becomes a command to attempt to 
put into words what the patient is trying to 
communicate whenever the patient comes to 
a stop. That this is a developmental trend in 
nondirective therapy is suggested by the re- 
sults of Seeman’s comparison of nondirective 
therapy ten years earlier with present-day 
illustrations (12). One of his findings was 
that a greater proportion of current nondirec- 
tive therapists’ responses could be character- 
ized as clarification and a smaller proportion 
of them could be characterized as simple ac- 
ceptance. According to the meaning of these 
categories it would seem that nondirective 
therapists have tended to increase the amount 
of effort expended in verbalizing patients’ 
feelings and have decreased the frequency 
with which they respond with relatively sim- 
ple listening responses. This might lead to the 
possible conclusion that nondirective thera- 
pists are less ambiguous now than they were 
ten years ago, as contrasted with the nondi- 
rectivists’ interpretation that they are under- 
standing their clients better. 


Application to Therapeutic Theory 
and Research 


The preceding discussion has been designed 
to demonstrate that ambiguity has meaning- 
ful relationships to personality theory and 
measurement and to therapeutic theory. In 
this section I shall attempt to show that this 
construct leads to further expansion and sys- 
tematization as well as to the formulation of 
testable hypotheses about therapeutic work. 
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Let us summarize and make more explicit the 
fundamental proposition which can be de- 
rived from therapeutic and personality theory, 
namely, that ambiguity in therapeutic rela- 
tionships serves three major functions. First, 
it capitalizes on the principle that ambiguous 
stimuli elicit from people those responses 
which are most heavily laden with the unique 
aspects of their life history. In other words, 
people invest ambiguous stimuli with their 
own motivational and emotional life. This 
function of ambiguity makes it possible for 
the patient, no matter how well oriented to 
reality, to bring into the therapeutic relation- 
ship his major conflictual feelings no matter 
how unaware he is of them. This, we think, is 
identical with the Freudian concept of trans- 
ference so that ambiguity is one of the facili- 
tating factors in the appearance of transfer- 
ence phenomena in therapeutic relationships. 
Second, by leading to this investment of the 
patient’s motivational and emotional struc- 
ture, ambiguity makes it possible for the 
therapist to understand more fully and more 
deeply the mainsprings of the patient’s ac- 
tion. Third, by being ambiguous, the thera- 
pist provides a background against which 
the patient’s irrational feelings will be more 
clearly etched and therefore more readily 
brought to awareness. Ambiguity helps to in- 
sure the effectiveness of the well-timed in- 
terpretation. 

I shall outline four different areas for which 
the concept of ambiguity can lead to further 
clarification of therapeutic phenomena and 
point the way to significant therapeutic re- 
search. 

1. The attempt to master the complexity 
of therapy makes us susceptible to reduction- 
istic approaches such as would be reflected in 
ruling that all relationships to be therapeutic 
must be ambiguous for the patient. But the 
functions of ambiguity in therapeutic rela- 
tionships must be balanced against our con- 
ceptions of the role of anxiety. While anxiety 
is considered a necessary ingredient of effec- 
tive therapy, our present knowledge leads us 
to believe that there is an optimal level of 
anxiety for each patient and that as the level 
of anxiety begins to exceed that point, the pa- 
tient starts to be overwhelmed by his anxiety 
and eventually all of his energies are con- 


sumed in self-preservative efforts, leaving no 
energy for therapeutic movement. 

Psychoanalytic personality theory provides 
a basis for expecting that anxiety will be posi- 
tively related to ambiguity. This theory as- 
sumes that people try to defend themselves 
against anxiety associated with conflictual im- 
pulses by denying to awareness or distorting 
those stimuli associated with the impulse. 
Where the stimuli are ambiguous, the dis- 
criminative processes necessary for defense 
are hampered and greater anxiety will result. 
Dibner (5) found evidence to confirm the de- 
duction that anxiety will be positively related 
to ambiguity in an interpersonal relationship. 
He applied Osburn’s (10) methods of measur- 
ing ambiguity to admission interviews with 
patients referred to the psychiatric service of 
a general hospital. His interviewers, clinical 
psychologists, carried out half of their inter- 
views with a set to be ambiguous and the 
other half with a set to be structured. Their 
compliance with the instructions was con- 
firmed by measures of ambiguity applied to 
their interviews. 

From this confirmed hypothesis of a posi- 
tive relationship between ambiguity and anx- 
iety one can move to the further deduction 
that the more intense the person’s conflict 
and the weaker his discriminative and defen- 
sive capacities, the greater will be the anxiety 
experienced at any given level of ambiguity. 
in other words, patients, varying in their per- 
sonality structure and particularly in the flexi- 
bility and effectiveness of their integrative 
processes, will vary in the amount of threat 
and anxiety experienced in ambiguous inter- 
personal relationships. Thus, it becomes neces- 
sary for the therapist to relate the degree of 
ambiguity to the level of anxiety which will 
be optimal for the particular patient. Perhaps, 
one of the critical factors distinguishing effec- 
tive therapeutic work with schizophrenic pa- 
tients from work with neurotics is the lesser 
degree of ambiguity which is demanded in re- 
lationships with schizophrenics. This distinc- 
tion would be consistent with the assumption 
that schizophrenic personalities are character- 
ized by inadequate and weak ego-integrative 
abilities. The schizophrenic needs help and 
encouragement to increase his contact with 
reality. Even when presented with relatively 








14 Edward S. Bordin 


unambiguous stimulus situations, he is likely 
to react in purely idiosyncratic personal 
terms. Fromm-Reichmann (8) has taken a 
similar position when she holds that the ana- 
lytic free-association process was inappropri- 
ate for schizophrenic patients. 

In looking at ambiguity as a factor in the 
therapeutic relationship, we must not over- 
look the fact that the therapist may also be 
subject to its anxiely-provoking effects. In 
many cases, the structuring of the relation- 
ship comes from the therapist’s anxiety and 
discomfort in too free a relationship, one in 
which he is not able to control and foresee 
the exact direction of the patient’s reactions.° 

2. As was suggested in our preceding dis- 
cussions of the functions of ambiguity, we can 
hypothesize that the intensity of the transfer- 
ence will be a function of duration and de- 
gree of the ambiguous aspects of the relation- 
ship. This hypothesis must be modified by 
consideration of the effects of the patient’s 
personality structure on his susceptibility to 
transference. The more highly integrated the 
person and the greater his consequent ability 
to react realistically, the more linear will be 
the relationship between ambiguity and in- 
tensity of transference. 

3. There has been a great deal of confusion 
about the degree of identity between the terms 
“counseling” and “psychotherapy.” Counsel- 
ing has been applied to therapeutic work with 
relatively restricted goals with normally inte- 
grated clients. Restriction in therapeutic goals 
usually means limiting intensity of trans- 
ference. Further, normally integrated clients 
are usually subject to only minimal anxiety. 
Therefore, they are less ready to enter a situa- 
tion in which the act of entering and the con- 
ditions of the task imply admissions of per- 
sonal inadequacy. The nature of the extremely 
ambiguous situation is such that, in effect, the 
therapist is saying, “do not try to make the 
usual discriminations; just speak out in re- 
sponse to your impulses.” The implication is 
that the therapist will protect the client from 
harm. This is almost a childlike relationship 
which the normally integrated minimally anx- 
ious client will be unwilling to accept. His 


6 This hypothesis is to be tested in a study planned 
by David Rigler. 


slight incapacities will not provide sufficient 
motivation to compensate for the loss in self- 
esteem in accepting such a relationship. It is 
likely that this characteristic of less ambi- 
guity will take the form of focusing reactions 
by the counselor designed to help the client 
restrict self-exploration and self-expression to 
those areas of emotion and motivation which 
are specific to a given problem situation, e.g., 
making a vocational decision. These two fac- 
tors then, the need to control transference 
and the kind of relationship acceptable to the 
counseling client, suggest that counseling re- 
lationships will be characterized by less am- 
biguity than is true in psychotherapy. Coun- 
seling and psychotherapy have been difficult 
to differentiate. If ambiguity is, in fact, one 
variable on which they can be differentiated, 
it will still be difficult to differentiate them 
dichotomously because therapeutic relation- 
ships will probably not distribute themselves 
in a clearly discontinuous manner. 

4. On first analysis, I expected that psy- 
chotherapy would be characterized by de- 
creasing ambiguity as the relationship pro- 
gressed. This expectation was based on the 
notion that even where the therapist imposes 
a strict free-association process, eventually he 
does begin to communicate interpretively to 
the patient, thus giving greater structure to 
himself and his reactions to the patient. In- 
evitably with time, the patient has the oppor- 
tunity to obtain cues about the therapist and 
his expectations which define him more con- 
cretely. However, Osburn (10) obtained nega- 
tive results when he tested this hypothesis in 
studying a sample of counseling relationships. 
One way to interpret these results is that a 
revision in theory is indicated. However, these 
negative findings do not in themselves in- 
validate our first hypothesis. The negative 
findings could be due to the fact that this 
hypothesis is not applicable to counseling 
situations, but only to those situations char- 
acterized by greater ambiguity. If much more 
intensive therapeutic situations were subjected 
to analysis, we might then expect to find that 
the interpretive process has served to struc- 
ture the situation to an increasing extent as 
therapy progressed. 

Even though the above rationale retains the 
original prediction about the trend of ambi- 
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guity in therapy, the further examination of 
the issue occasioned by Osburn’s results has 
led to certain additional hypotheses. While to 
an observer the stimulus character of the 
therapeutic situation becomes increasingly 
structured as a function of increased interpre- 
tive effort, the dynamics of the situation may 
be such that, for the patient, the ambiguity 
has not decreased. When a therapist’s inter- 
pretation is experienced by the patient as an 
increase in intensity of his awareness of him- 
self, it will be the patient, himself, as a stimu- 
lus object which becomes more structured, 
not the therapist. When the therapist points 
out to the patient the many ways in which he 
is defending himself against passive impulses, 
the patient experiences this as, “Yes! I feel 
dependent, I want to be dependent and I am 
afraid of these feelings,” rather than, “He 
thinks I am dependent and that I am afraid 
of these feelings.’’ Such will be the stimulus 
situation for the patient when he is at a stage 
where he is rushing ahead toward self-discov- 
ery. But there are also stages where the ap- 
proaching awareness is freighted with irra- 
tional fear and the patient is actively seeking 
to avoid it. At these times the confronting 
type of interpretation, even when effective, is 
likely to be experienced as indicating to the 
patient what the therapist thinks o: him 
rather than as a characteristic of himself, thus 
structuring the situation. Similarly, inappro- 
priate interpretations will have the same effect. 


Summary 


In this paper, the concept of ambiguity as 
one characteristic of interpersonal relation- 
ships relevant to their therapeutic effect has 
been outlined. Ambiguity is a quality of the 
stimulus characteristics of the therapist and 
the therapeutic task which permits patients 
to vary their perceptions and responses to the 
therapist as a function of their personality 
structures. Methods of measuring this quality 
have been developed and applied in research 
on psychotherapy. The previous explicit and 
implicit uses of this concept in personality 
theory and measurement and in theories of 
psychotherapy have been reviewed. Finally, 


predictions were made about the functional 
relationship between this variable and ther- 
apy with schizophrenics, the experience of 
anxiety, the distinctions between counseling 
and psychotherapy, and about its relation- 
ships to interpretation. 


Received May 21, 1954. 
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Differences Between Verbal and Performance IQ's 
with Mentally Defective Children on the 
Wechsler Intelligence Scale for Children’ 


J. Robert Newman 


University of Illinois 


and Frank M. Loos 


Lincoln State School 


The main purpose of this study was to 
gather evidence on whether or not there are 
differences between VIQ and PIQ for men- 
tally defective children. 

Three groups of mentally defective chil- 
dren, classified as familial (NV = 128), undif- 
ferentiated (NV = 75), and brain damaged 
(N = 28), were selected for study. The chil- 
dren selected ranged in age from 7 to 16 
years, had Full Scale IQ’s of 50 or higher, 
and showed no evislence of severe motor de- 
fect such as paralyses, tremors, etc. All chil- 
dren were in state institutions in the State of 
Illinois and were administered the WISC by 
staff psychologists. ' 

Two hypotheses -were tested: (a) There is 
no ‘difference between Verbal and Perform- 
ance IQ’s for any of the three groups. (0d) 
There are no differences between group psy- 
chometric patterns. formed by the VIQ and 
PIQ. 

Statistical analyses of the WISC subtest 
scores yielded results from which the follow- 
ing tentative conclusions can be made: 

1. Mentally defective children classified as 
familial perform significantly higher as a 
group on the Performance subtest than on the 


1An extended report of this study may be ob- 
tained without charge from J. Robert Newman, 
Department of Psychology, University of Illinois, Ur- 
bana, Illinois, or for a fee from the American Docu- 
mentation Institute. To obtain it from the latter 
source, order Document No. 4453 from ADI Auxiliary 
Publications Project, Photoduplication Service, Li- 
brary of Congress, Washington 25, D. C., remitting 
in advance $1.75 for microfilm or $2.50 for photo- 
copies. Make checks payable to Chief, Photoduplica- 
tion Service, Library of Congress. 


Verbal subtest. The mean IQ difference was 
8.07. 

2. Mentally defective children classified as 
undifferentiated also performed significantly 
higher as a group on Performance than on the 
Verbal subtest, but the mean difference (4.8) 
is not as great as for the familials. 

3. Mentally defective children classified as 
having some kind of brain damage due to in- 
fection or birth trauma and showing no evi- 
dence of severe motor defect showed no dif- 
ference between VIQ and PIQ. 

4. Mentally defective children with brain 
damage of the type described above perform 
uniquely on the WISC as a group to the ex- 
tent that they obtain a higher VIQ and lower 
PIQ than the undifferentiated group. 

The above conclusions refer to group dif- 
ferences and a word of caution is necessary 
for those who wish to consider the signifi- 
cance of a difference score for an individual. 
By making use of the mean reliabilities of 
two tests and the intercorrelations of these 
tests it is possible to determine what percent- 
age of difference scores is real, i.e., due to 
nonchance factors. For the WISC Verbal and 
Performance tests this percentage is 42. The 
implication should be clear. Less than half of 
any differences found between these two tests 
will be true (reliable), nonchance differences. 
Obviously when considering the individual 
case only the largest of differences should be 
considered trustworthy, and small differences 
should be attributed to errors of measure- 
ment. 

Brief Report 
Received September 17, 1954. 
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A Systematic Approach to the Construction of 
Hypotheses About the Process of Psychotherapy 


Jum C. Nunnally ’* 


University of Illinois 


Most hypotheses about psychotherapy come 
from the therapist’s recollection of the process 
in individual cases. This procedure has the 
weak points of being dependent on memory 
and lacking in statistical aids to analysis. The 
method presented here offers a means of 
codifying the therapist’s impressions at vari- 
ous points in the therapy. Trends in the data 
can be easily charted and it is possible to 
obtain factors and relations among factors of 
which the therapist himself is not aware. The 
method deals with the therapist’s impressions 
and in that sense is subjective. The purpose 
of the method is to generate some operational 
hypotheses about the process of psychotherapy 
that can be verified in other experiments. 

If we assume that the therapist judges some 
client behaviors to be more important or in- 
dicative than others, and that these “im- 
portant” behaviors have a generality from 
case to case, a “universe” of relevant indi- 
cators could be defined for the individual 
therapist. Samples from the universe of be- 
haviors could be treated statistically. Stephen- 
son (2, 3) has developed a method for work- 
ing with such samples. The method requires 
that the sample be rated along a continuum 
relative to an “instructional set.” The scores 
obtained are susceptible to the ordinary sta- 
tistics of correlation and ¢ test and to the 
elegancies of factor analysis and analysis of 
variance. 

The method being recommended would 
start with a concrete therapy case—any case 
would do. The therapist’s collection of “im- 
portant behaviors in therapy” would be repre- 

1 Grateful acknowledgment is given to Dr. Carl 


Rogers for his part as therapist in the experiment 
and for his help in developing the ideas presented. 
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sented in a sample. These could be-such as 
“acted casual and indifferent about his prob- 
lems,” “asked many questions about my per- 
sonal life,” and “spent much time in thanking 
me for the help.” A standard sample could be 
made for the more general approaches, such 
as Freudian, client-centered, and Adlerian; 
but logically each therapist’s particular no- 
tions could be represented. 

The logic of sampling stimuli, in this case 
statements about therapy, is similar in prin- 
ciple to the more conventional sampling of 
people. First, it is mecessary to define the 
sampling unit and the universe to be sampled, 
here Rogers’ notions about therapy (1). If 
there is a formal theory involved in the ex- 
periment, it can be represented by “effects” 
and “level” in factorial design. When there is 
no formal theory involved in the experiment, 
as in the present case, the sampling follows 
principles of randomization. The first step in 
this procedure is to make an exhaustive collec- 
tion of the statements in the specified uni- 
verse. This larger collection of statements is 
then randomly sampled in order to obtain a 
manageable number for the experiment. All 
of the conventional sampling statistics then 
apply to the relations between the experi- 
mental sample and the parent collection of 
statements. If the parent collection of state- 
ments has been sufficiently exhaustive, there 
is reason to believe that the experimental 
sample will be representative of the defined 
universe of statements. 

The experimental design would require the 
therapist to describe the therapy at regular 
intervals with the trait sample. At the con- 
clusion of therapy, the obtained Q-sort de- 
scriptions could be intercorrelated and factor 
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analyzed. The nature of the factors and the 
pattern of loadings would provide a sounder 
basis for theorizing about the therapy process 
than previous procedure. 

The example to be described was taken 
from the case of a young woman who par- 
ticipated in 47 interviews of client-centered 
therapy. The trait sample was collected from 
Client-Centered Therapy (1), largely from 
Chapter 3. The 60 statements” obtained were 
balanced positively and negatively to repre- 
sent the appearance of an important behavior 
and its opposite. The following are examples 
of the statements included in the sample: 

1. Feeling confused about what others really think 

of her. 

2. Wanting to impress and please therapist. 


3. Wondering how change can come about. 
4. Struggling to express herself. 


Soon after the therapy hour, the therapist 
was asked to describe the client’s behavior by 
distributing the trait sample along a nine- 
point continuum. Each of the nine points on 
the continuum was designated by a category 
number, ranging from 0 to 8. A forced dis- 
tribution was required f«r rating the 60 traits 
such that they conformed to a quasi-normal 
curve. The frequencies required at each of 
the nine points on the continuum were 2, 3, 
7, 11, 14, 11, 7, 3, and 2, respectively. 
Stephenson (2, 3) gives a more complete 
description of this rating procedure. 

The two statements placed in pile 8 were 
deemed most descriptive of the particular 
therapy interview, the three statements placed 
in pile 7 were next most descriptive of the 
interview, and so on down the continuum to 
the two statements in pile zero that were 
thought to be the opposite of what took place. 
Statements placed in the middle of the con- 
tinuum were neither characteristic nor un- 
characteristic of the interview. 

The therapist described the therapy on 
eight occasions,® at interviews 1, 4, 7, 11, 15, 


2A more complete study with the method being 
described would necessitate the use of a larger sam- 
ple of traits. One hundred statements would more 
nearly meet the requirements. 

38 The limited number of sorts was necessitated by 
restrictions on the therapist’s time and by choosing 
interesting sessions to describe. A substantive ex- 
periment with this method would require a dozen 
or more sorts. 


25, 38, and 47. The eight descriptions, each a 
variate in the experimental design, were inter- 
correlated * and factor analyzed (see Tables 
1, 2, 3, and 4). The two factors obtained were 


Table 1 


Intercorrelations Among Sorts 

















Sort | 2 3 4 5 6 7 8 
1 
2 18 ~ 
3 —23 51 —_ 
4 —08 61 6 — 
5 —21 35 6&4 56 -— 
6 —45 Ol 54 28 54 - 
7 —-17 39% 53 S6 32 44 — 
8 —54 —21 36 O02 32 72 290— 
Note.—Decimal points omitted. 
Table 2 
Centroid Factor Matrix* 
Sort I II ? est. /? 

1 — 39 50 40 43 

2 43 67 63 64 

3 84 18 74 73 

4 70 52 76 74 

5 69 06 48 50 

6 74 —4l 72 72 

7 63 11 41 44 

8 55 —67 75 71 
Note.—Decimal points omitted. 
* Thurstone’s (5) method of centroid factor analysis was 

used. 


* Because of the use of a standardized distribution 
for all of the sorts, the product-moment correla- 
tion coefficient can be taken as follows: r=1— 
(2a*/2Neo*). The symbol d stands for item differ- 
ences in the two variates being correlated. Because 
2No* is a constant for all of the sorts made with a 
particular distribution, a table can be constructed for 
transforming any =d° directly into a correlation co- 
efficient. With these convenient procedures, corre- 
lation coefficients can be obtained at the rate of 20 
to 30 an hour. 

Reliability estimates for the Q sort can be made 
in several ways. A duplicate set of statements can 
be formed and these can be correlated with the ex- 
perimental sample on the same occasion or after a 
period of time. The reliability estimate can be 
made by simply repeating a particular sort with the 
same sample after a period of time. Often it is 
easier to estimate the reliability from the matrix of 
intercorrelations. It is a safe assumption that the 
reliability will be at least as high as the median 
communality. 
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Table 3 


Distribution of Second-Factor Residuals* 











r Frequency 
00 1 
01 7 
02 5 
03 4 
O4 4 
05 4 
06 1 
07 1 
12 1 





Note.— Decimal points omitted. 
* Signs being ignored. 


Table 4 
Rotated Orthogonal Factor Matrix 








Interview Sort I’ Il’ 
1 1 —28 —55 

4 2 53 —57 

7 3 85 —03 

11 4 77 — 37 

15 5 67 07 

25 6 65 53 

38 7 63 00 

47 8 42 75 


Note.—Decimal points omitted. 


placed through one orthogonal rotation® to 
“sharpen” the relationships made apparent by 
the factors. Each factor can be considered an 
“effect” with the loadings measuring the ex- 
tent to which the therapist judged each ef- 
fect to dominate the separate interviews. 
From factor scores* obtained for each of 


5In connection with the rotational problem here 
it is interesting to note that principles of “simple 
structure” do not apply to factor matrices resulting 
from the use of this method. It would be difficult 
to conceive of the variates here being segregated in 
clusters in the vector space. This would mean that 
the client moves along under one set of conditions 
and then suddenly jumps to a wholly different set 
of reactions. The solution found here, where the 
variates are distributed continuously through the 
vector space, is more likely. 

6 Factor arrays are obtained by weighting the vari- 
© L i ; 
ates by the formula te (4, Appendix XX) 
and averaging the item scores across variates. 


the traits, the following traits are found to be 
high, positively and negatively, in factor I’: 


Factor I’ 
Most Characteristic 

Experiencing ambivalent attitudes toward self 

Experiencing the therapist as accurately understand- 
ing. 

Experiencing warm rapport with therapist 

Feeling relieved to have an hour of her own to just 
do what she likes. 

Wondering who and what she really is. 

Experiencing the therapist as interested and wanting 
to understand. 

Feeling skeptical of the “validity” of her own experi- 
ence 

Most Uncharacteristic 

Feeling annoyed with therapist. 

Feeling interest and concern for the therapist as an 
individual. 

Feeling that the whole effort is futile. 

Worrying about how the therapist sees her. 

Feeling that others should change to make her lot a 
more comfortable one. 


The items characteristic and uncharacter- 
istic of factor II’ are as follows: 


Factor II’ 
Most Characteristic 
Experiencing real happiness 
Perceiving self from values rooted in primary ex- 
perience. 
Experiencing comfort in being her real self. 
Feeling pride in assuming responsibility for self 
Working from new insights to reoriented behavior 
Experiencing progress in therapy. 
Most Uncharacteristic 
Wondering what the therapist expects of her 
Perceiving self in terms of values introjected from 
others. 
Feeling difficulty in talking about self. 
Feeling that she just isn’t capable of facing her 
problems. 
Wanting the therapist to assume the burden of ef 
fort—wanting key to problems 


Factor I’ could be interpreted as a client- 
therapist interpersonal activity concerned with 
the development of trust, faith, and warm 
emotions. Factor II’ is more intrapersonal for 
the client, aimed at free exploration and self- 
trust. It is interesting that the therapist sees 
the client at her happiest when factor II’ pre- 
dominates, and ambivalent about herself when 
factor I’ is the strongest influence. The thera- 
pist apparently does not think of the warmth 
in factor I’ as directed toward himself as an 
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individual. Note the statement “feeling in- 
terest and concern for the therapist as an in- 
dividual” appearing as the second most un- 
characteristic trait in factor I’. 

Both factors are in the negative at the be- 
ginning of therapy: there is neither interper- 
sonal nor intrapersonal “good-will.” Factor 
I’ becomes positive on the second sort (the 
fourth interview), reaches a maximum on the 
third sort, and gradually declines to the close 
of therapy. The implication is that behaviors 
relative to interpersonal warmth grow and 
then decline, perhaps necessarily so in the 
successful therapy. 

Factor II’ is less steady in its trend. It is 
not until the sixth sort that the factor is sig- 
nificantly positive. It becomes zero again in 
the seventh and rises to its maximum in the 
last interview. Rising later than factor I’, 
factor II’ can be construed as dynamically 
closer to the conceived basic process of ther- 
apy. Factor I’ becomes significantly positive 
in the fourth interview (second sort), but it 
is not until twenty-one interviews later that 
factor II’ comes into play. 

The analysis raises the following sorts of 
questions: 

1. What behavior on the part of the thera- 
pist is necessary to bring each of the factors 
about? 

2. Would it be possible to have factor I’ 
in the negative and factor II’ positive (would 
it be possible for the client to actively dislike 
and distrust the therapist, yet freely to ex- 
plore himself) ? 

3. Is happiness a necessary part of factor 
II’ and ambivalence a necessary part of I’ or 
can these relationships be better explained by 
the expectations of the therapist? 


4. Could the prolonged and undiminishing 
preocupation with factor I’ prevent the self- 
trust and self-exploration deemed necessary 
for therapy? 

5. Would these factors arise in other ther- 
apies done by therapists of different orienta- 
tions? Would the differences be reflected 
linguistically (as shown by the “important” 
behaviors included in the particular therapist- 
sample) more than in the nature of the fac- 
tors obtained? 


Summary 


A method has been shown for systemati- 
cally studying the therapist’s impressions 
about the process of psychotherapy. It en- 
tails a O-method (2, 3) treatment of samples 
of “important behaviors in therapy” taken 
from current theoretical works. The approach 
allows the therapist’s observations to be con- 
veniently recorded and analyzed by appropri- 
ate statistics. The purpose of the method is 
to generate some more operational hypotheses 
about the therapy process than presently 
exist. One case is analyzed to show the 
method at work. 


Received May 17, 1954. 
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Alienation, Social Apperception, and Ego Structure’ 


Anthony Davids 


Harvard University 


Examination of the recent psychological 
literature bears wituess to the fact that an in- 
creasing amount of research attention is being 
devoted to the study of social perception (1, 
2, 3, 4, 5, 6, 7, 12, 13, 15, 16). This trend in 
research interest would seem to be a natural 
concomitant of the emphasis placed on in- 
terpersonal relations in contemporary person- 
ality theory and psychiatric practice. With- 
out doubt, most investigators of personality 
would agree that effectiveness of social rela- 
tions is an important component of general 
environmental adjustment, and that accurate 
social perceptions should be conducive to 
satisfactory social relations. Despite agree- 
ment in regard to the importance of this phe- 
nomenon, commonly termed social perception, 
at the present time the psychologist is faced 
by a multiplicity of unsolved problems con- 
cerning relations between personality at- 
tributes in the perceiver and his evaluative 
interpretations of other persons in his social 
environment. The present investigation rep- 
resents an attempt to contribute to further 
understanding of these relations. 

More specifically, the twofold purpose of 
this study is to develop an objective tech- 
nique for investigating personality and social 
apperception, and to test a series of predic- 
tions pertaining to relations between subjects’ 
ego structure, their apperceptions of the 


1This investigation, conducted at the Harvard 
Psychological Clinic under the direction of Dr. Henry 
A. Murray, was facilitated by the Laboratory of So- 
cial Relations. It was supported in part by a re- 
search grant from the Rockefeller Foundation, and 
grant M-700 from the National Institute of Mental 
Health, U. S. Public Health Service. The author 
wishes to express his appreciation to Dr. Murray, 
who collaborated in the design and construction of 
the Affect Questionnaire, and provided the clinical 
evaluations of ego structure. 
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world, and their estimates of other persons’ 
apperceptions. Throughout this presentation, 
the term apperception will be used in place of 
the more common term perception. By use of 
this concept we do not wish to give the im- 
pression that we are exploring some novel 
area of investigation. The focus of this re- 
search is definitely on the problem area that 
in the bulk of the literature is labeled social 
perception. Our choice of the concept apper- 
ception is in accord with the distinction be- 
tween perception and apperception made by 
Murray (9), in which the latter term is used 
to designate the process whereby meaning is 
assigned to a physical stimulus, and includes 
such things as understanding, interpretation, 
and classification. In the present study ap- 
perception refers specifically to a perception 
involving an evaluative interpretation of 
situations and people in the perceiver’s world. 


Method 
Subjects 


The subjects were 20 Harvard undergradu- 
ates who volunteered to participate in an in- 
tensive study of personality. These subjects, 
selected from a large introductory course in 
psychology, were paid for their services at the 
current student employment rate. They were 
selected with the goal of obtaining a group of 
young men with varied backgrounds, interests, 
abilities, and personalities. 


The Affect Questionnaire 


Description. The Affect Questionnaire was 
designed to reveal three things in regard to 
certain critical dispositions of personality: 
(a) the relative amount of the disposition in 
the subject’s personality; (5) the relative 
amount of the disposition he apperceives in 
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the personalities of other people in his social 
environment; and (c) his evaluation (posi- 
tive-negative) of the given disposition. The 
eight dispositions measured by this instru- 
ment are: sociocentricity, optimism, trust, 
egocentricity, pessimism, distrust, anxiety, and 
resentment. Of these dispositions, the first 
three are “positive” or socially desirable, and 
the last five are “negative” or socially un- 
desirable. 

There are three forms of the Affect Ques- 
tionnaire, which are identical in content but 
differ in instructions. The content consists of 
ten statements designed to relate to each of 
the eight dispositions, making a total of 80 
items. For each disposition a greet many 
statements indicative of evaluative appercep- 
tions of the world and its people were writ- 
ten; some were original constructions by the 
experimenters, and others were culled from 
sources such as Stevenson’s The Home Book 
of Quotations (14), and Murray’s Explora- 
tions in Personality (10). From this host of 
items we selected what we believed to be the 
ten best items for tapping each disposition 
from a variety of approaches. The ten items 
representative of each of the dispositions 
were then mingled in a random, but system- 
atic, order to constitute the final 80-item 
questionnaire. 

Following are the first eight statements as 
they appear on the Affect Questionnaire: 


1. The most profound happiness is reserved for 
those who are capable of selfless dedication to a 
cause. 


2. No longer can a young man build his character 
and his hopes on solid ground: civilization is crum- 
bling, the future is dreadfully uncertain, and his life 
hangs by a thread. 

3. People will be honest with you as long as you 
are honest with them. 

4. A man who never gets angry at anything or 
anyone is not likely to be treated with respect. 

5. There are days when one awakes from sleep 
without a care in the world, full of zest and eager- 
ness for whatever lies ahead of him. 

6. Beneath the polite and smiling surface of man’s 
nature is a bottomless pit of evil. 

7. There are times when it is absolutely necessary 
to use other people as tools in the accomplishment 
of a purpose. 

8. The real substance of life consists of a proces- 
sion of disillusionments, with but few goals that are 
worth the effort spent in reaching them. 


Administration. The instructions require the 
subject to rate each statement by marking 
the appropriate point on a 6-point scale, run- 
ning from “strongly disagree” to “strongly 
agree.” He responds to these statements un- 
der each of the three following conditions con- 
sidered in this order: (a) the way he thinks 
the “average Harvard student” would rate 
them; (5) the way he himself rates them; 
and, finally, (c) the way he thinks his “ideal 
person” would rate them. In other words, first 
the subject is presented with a copy of the 
questionnaire with mimeographed instructions 
to respond to each statement the way he 
thinks the average Harvard student would re- 
spond to it. When he has completed this task, 
he is presented with another copy of the 
same questionnaire, only this time the in- 
structions state that he is to indicate his own 











Table 1 
Rank-Order Correlations (Rho) Between Scores on the Eight Dispositions on the Affect Questionnaire 
(N = 20) 
Socio- Ego- 
Disposition Optimism Pessimism Trust Distrust centricity centricity Resentment 

Optimism 
Pessimism —.47* 
Trust +.43* —.64*** 
Distrust —.41* -+.84*** — .82*** 
Sociocentricity +.29 — 40* +.80*** — .62*** 
Egocentricity —.10 +.76*** — .64*** +.75*** — .52** 
Resentment — .09 +.59*** — .38* +.64*** — .57*** +.54** 
Anxiety —.29 +.82*** — .54** +.86*** — .42* +.67*** +.58*** 





* Significant beyond the .05 level for a one-tailed test. 
** Significant beyond the .01 level for a one-tailed test. 
*** Significant beyond the .005 level for a one-tailed test. 
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personal feeling of agreement or disagree- 
ment with each statement. Finally, he is pre- 
sented with a third copy of the same ques- 
tionnaire, and this time he is instructed to, 
“Rate the following statements as you be- 
lieve the ideal person would rate them. The 
ideal person may be real or mythical, living 
or dead, or purely imaginary. This person 
should be someone admirable in your eyes, 
someone who possesses the attributes which 





you would most like to have in your own 
personality.” 

Scoring. Separate scores were computed 
from responses elicited under the three dif- 
ferent conditions by the same scoring system. 
The response to each statement was scored 
from 1 to 6 depending upon the degree of 
agreement indicated by the subject, with com- 
plete disagreement receiving a score of 1, and 
complete agreement receiving a score of 6. 
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Fig. 1. Affect Questionnaire scores under three conditions. Dispositions, and their abbreviations, indi- 
cated on the abscissas are as follows: sociocentricity (Soc); trust (Tr); optimism (Opt); egocentricity 
(Ego) ; distrust (Dist); pessimism (Pess); resentment (Res); anxiety (Anx). 
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Scores assigned to the ten items representa- 
tive of each of the dispositions were then 
summed, resulting in a total score for each 
separate disposition. 

The statistical finding of highly significant 
intercorrelations between these scores, pre- 
sented in Table 1, led to the formulation of 
a syndrome for which the term alienation 
seemed most fitting. This syndrome is com- 
posed of the following five interrelated dis- 
positions: egocentricity, distrust, pessimism, 
anxiety, and resentment. Our findings indi- 
cate that subjects who are high on any one of 
these dispositions tend to be high on all of 
them. The subjects were rank ordered in 
terms of: (a) the amount of alienation evi- 
denced in their self-avowals of agreement with 
the statements indicative of negative disposi- 
tions; (6) the amount of alienation they be- 
lieve would be evidenced by the average 
Harvard student; and (c) the amount of 
alienation they indicate would be character- 
istic of their ideal person. 

An individual graph was plotted for each 
subject, showing his scores for each disposi- 
tion under the three different instructions. A 
few of the graphs, identified by the subjects’ 
pseudonyms, are shown in Fig. 1. From these 
scores it was possible to rank order the sub- 
jects in terms of the following variables: (a) 
inaccuracy of social apperception; (0) dis- 
crepancy between self and the apperceived 
average Harvard student; and (c) discrep- 
ancy between self and the ideal person. 

Profile analysis. Visual inspection of the 
graphs presented in Fig. 1 indicates marked 
individual differences. By way of example we 
will discuss briefly a few of these differences. 


Lookout, who is the highest ranking subject on 
self-alienation, reveals that he apperceives the aver- 
age Harvard student as only slightly lower on aliena- 
tion than himself, and that he feels both he and the 
average student are considerably more alienated than 
the ideal person. Diner, who is the third highest on 
self-alienation, apperceives very little discrepancy be- 
tween scores for the average Harvard student and 
the ideal person, but shows pronounced discrepancy 
between these scores and his self scores. Keeno, who 
ranks seventeenth on self-alienation, shows hardly 
any discernible difference among his scores under the 
three different conditions. Although in the present 
report the focus is on hypothesis testing, rather than 
diagnosis of individual personalities, it is encourag- 
ing to note that the impressions gained from inspec- 


tion of these profiles are, in most cases, in keeping 
with diagnoses based on intensive analysis of data 
secured by means of a variety of standard clinical 
procedures. At this point, we wish merely to point 
to the interpretive possibilities of the individual pro- 
files, and suggest that eventually this procedure may 
prove to be an efficient and fruitful method for as- 
sessing personality. 


Ego Structure 


Before being accepted as a research sub- 
ject, each individual underwent a brief fact- 
finding interview with an experienced clinical 
psychologist. At a later date, after reading the 
detailed autobiography written by each sub- 
ject, this psychologist conducted a second per- 
sonal interview. His clinical evaluations, based 
on the findings from the autobiography and 
the two interviews, were expressed by rank 
ordering the subjects in terms of “ego struc- 
ture.” This concept of “ego structure” or “ego 
strength” has been defined in detail by Mur- 
ray and Kluckhohn (11). There is a good 
deal of clinical evidence of a high degree of 
interdependence between ego structure, as 
therein defined, aud good personal and social 
adjustment. In the present study, ego struc- 
ture has been taken as an indirect measure of 
adequacy of adjustment. 


Hypotheses, Findings, and Discussion 


The highly significant intercorrelations be- 
tween subjects’ self scores on the five negative 
dispositions, which comprise the syndrome 
termed alienation, led to the formulation of 
several hypotheses pertaining to personal ap- 
perceptions and social apperceptions of peo- 
ple who are high on alienation. 

Hypothesis I: Subjects who are high on the 
syndrome of alienation will be less accurate 
in their social apperceptions than subjects 
who are low on the syndrome of alienation. 

In order to test this hypothess it was nec- 
essary to secure an index of accuracy of so- 
cial apperception. One criterion of accurate 
social apperception, most clinicians would 
agree, is the ability to make accurate judg- 
ments in regard to the sentiments and opin- 
ions of one’s fellowmen. If one is to have 
satisfactory interpersonal relations, he must 
be sensitive to the feelings and attitudes of 
the people in his environment. The more one 
distorts, or misperceives, the personalities of 
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those around him, the less likely he is to make 
a good adjustment to his surroundings. 

A measure of accuracy of social appercep- 
tion would be provided by comparing the 
subject’s apperceived “average Harvard stu- 
dent’s” responses with the actual average 
Harvard student’s responses. To arrive at 
scores representative of the mythical average 
Harvard student’s actual responses, the scores 
obtained by our subjects under the condition 
of their own self-agreement or disagreement 
with the statements were averaged. Natu- 
rally, our sample is small, and though selec- 
tion procedures were designed to secure a 
heterogeneous group, it is possible that the 
average scores for this group are actually not 
close to the “true” average of the Harvard 
college population. Therefore the results pre- 
sented here may well not represent the final 
word on this matter. But, with this qualifica- 
tion in mind, the discrepancy between each 
subject’s estimate of the responses of the av- 
erage person and the actual responses of the 
average person was taken as a measure of ac- 
curacy of social apperception. That is, the less 
this discrepancy, the more accurate the sub- 
ject’s social apperception. 

To test Hypothesis I, the subjects were 
ranked on the syndrome of alienation, and 
ranked according to the degree of discrep- 
ancy between their estimates of the average 
and the actual obtained average. The rank- 
order correlation coefficient (tau = + .142) 
is in the predicted direction, but does not at- 
tain the .05 level of significance. All statisti- 
cal findings reported in this section are shown 
in Table 2. 

The failure of this hypothesis to be con- 
firmed led to the formulation of the following 
hypothesis: 

Hypothesis II: Subjects who are low on 
alienation will apperceive the average Har- 
vard student as low on alienation, and those 
who are themselves high on alienation will 
apperceive the average Harvard student as 
high on alienation. 

Rank-order correlation between the sub- 
jects’ own rank on alienation and their rank 
on the basis of the amount of alienation ap- 
perceived in the average person is significant 
at the .003 level (tau = + .453), which con- 
firms Hypothesis IT. 


Table 2 


Self-Alienation on the Affect Questionnaire Correlated 
with Other Measures on the Affect Question- 
naire, and with Ego Structure Based 
on Clinical Evaluation 
(N = 20) 


Correlation Level of 


(tau[8]) with _ signifi- 
Measure self-alienation cance* 
Alienation of apperceived 
“average Harvard student” +-.453 003 
Discrepancy between self and 
apperceived “average Har 
vard student” +.429 005 
Discrepancy between self and 
the ideal person +.516 001 
Inaccuracy of social apper 
ception +.142 142 
Ego structure 411 006 


* One-tailed tests of significance 

These findings suggest that there are inac- 
curacies in the social apperceptions of both 
low-alienation subjects and _ high-alienation 
subjects, with a trend in the direction of a 
higher degree of accuracy in those subjects 
who are low on alienation. Although there is 
not a significant association between aliena- 
tion and accuracy of social apperception, con- 
firmation of Hypothesis II indicates that the 
type of apperceptual error is significantly dif- 
ferent in lows and highs, with subjects who 
are themselves low on alienation perceiving 
other people in their environment as low on 
alienation, and those who are high on aliena- 
tion perceiving others as high on alienation. 
In other words, defining “better” and “worse”’ 
in terms of cultural sanction and social ac- 
ceptability, low-alienation subjects see people 
as better than they really are, and high- 
alienation subjects see people as worse than 
they really are. 

This phenomenon provides a vivid example 
of the operation of self (supplementary) pro- 
jection, which is the tendency for people to 
perceive in others those things that are actu- 
ally in themselves. In classic Freudian termi- 
nology the concept of projection was em- 
ployed solely to describe the attribution of 
one’s negative, undesirable traits on to other 
people. But the present results suggest that 
the concept of projection is applicable to posi- 
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tive attributes as well as negative attributes, 
with happy, contented, well-adjusted indi- 
viduals tending to perceive others as similar 
to themselves, and, consequently, seeing them 
as less alienated than they really are. Those 
who are low on alienation look around them 
and see a lot of trustful, happy, sociocentric 
human beings, whereas those who are high on 
alienation look at these same people and de- 
cide that they are self-centered, resentful, 
anxious, and unhappy. 

In the attempt to discover additional rela- 
tions between alienation and social appercep- 
tion the following hypothesis was tested: 

Hypothesis II]; The degree of negative dis- 
crepancy between the subject’s own responses 
and the responses he attributes to the aver- 
age Harvard student will be greater in sub- 
jects who are high on alienation than in sub- 
jects who are low on alienation. 

There are two ways to receive a score in- 
dicative of negative discrepancy. The first is 
to apperceive the average Harvard student as 
being higher on a positively evaluated per- 
sonality disposition than is the self, and the 
second is to apperceive the average Harvard 
student as lower on a negatively evaluated 
personality disposition than is the self. 

Correlating rank on amount of negative 
discrepancy between self and the apperceived 
average Harvard student with rank on self- 
alienation results in a tau of + .429, which 
is significant at the .005 level. This finding 
indicates that individuals who are at either 
extreme on the variable of alienation tend to 
rate others as closer to the mean than them- 
selves. 

There remains one crucial relationship 
within the Affect Questionnaire, the compari- 
son of self scores on alienation with aliena- 
tion scores of one’s ideal person. 

The following hypothesis is concerned with 
this relationship: 

Hypothesis IV: The degree of negative dis- 
crepancy between the subject’s own responses 
and the responses of his ideal person will be 
greater in subjects who are high on aliena- 
tion than in subjects who are low on aliena- 
tion. 

To test this hypothesis, rank on amount of 
negative discrepancy between self and the 
ideal person was cvrrelated with rank on self- 


alienation. The resulting coefficient (tau = + 
.516) is highly significant, and confirms the 
above hypothesis. This finding confirms the 
widely held belief that an important cor- 
relate of unhappiness, and probably malad- 
justment, is the perception of the self as fall- 
ing below one’s standards and ideals. 

As alienation is believed to be a sign of 
emotional maladjustment, it seemed desir- 
able to correlate rank on self-alienation with 
some independent measure of adequacy of 
personal and social adjustment. The measure 
selected for this purpose is the psychologist’s 
rank order of the subjects in terms of ego 
structure. With these two measures, the fol- 
lowing hypothesis was tested: 

Hypothesis V: Subjects who are low on ego 
structure will be high on the syndrome of 
alienation. 

The predicted negative association was 
found (tau= — .411, p= .006) indicating 
that subjects who view the world and their 
relationship to it in a negative light have 
weak ego structure (poor adjustment) as 
evaluated by experienced clinical judgment. 
This finding of highly significant agreement 
between results of assessment by these dif- 
ferent methods speaks for the validity of the 
Affect Questionnaire as an objective method 
for investigating personality and apperception. 


Conclusions 


The over-all findings suggest the following 
picture of an alienated young man: He is a 
person whose apperceptions reveal relatively 
large amounts of egocentricity, distrust, pes- 
simism, anxiety, and resentment in his per- 
sonality. His social apperception is distorted 
in that he apperceives other people in his en- 
vironment as being more alienated than they 
actually are. Although he sees others as alien- 
ated, he apperceives his contemporaries as less 
alienated than himself, consequently less mis- 
erable than himself. And, finally, he feels that 
his negative evaluations of the world and its 
people are a far cry from the evaluations that 
would be characteristic of any person he 
would regard as admirable or ideal. 

The testing of the above hypotheses has re- 
vealed that in our sample there are individu- 
als who see themselves as far from their ideals 
and considerably worse off, socially and psy- 
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chologically, than their contemporaries. This 
syndrome of alienation, shown to correlate 
with weak ego structure, which permeates 
their self-picture and distorts their appercep- 
tions of others, must certainly influence their 
cognitive processes and their social relations. 
The cognitive and behavioral consequences 
of this syndrome should provide fertile ground 
for future investigation. 


Summary 


The purpose of this study was to develop 
an objective instrument for measuring ap- 
perception, and to test a series of hypothe- 
ses concerning relations between personal 
apperception, social apperception, and ego 
structure. Twenty Harvard undergraduates 
responded to a questionnaire containing 
evaluative statements representative of cer- 
tain critical dispositions of personality. Each 
subject responded to these statements under 
the following conditions or sets: (a) his own 
personal agreement or disagreement with 
them; (5) the degree of agreement he thinks 
would be indicated by “the average Harvard 
student”; and (c) the degree of agreement he 
thinks would be indicated by an ideal person. 

Statistical analyses of results on this ques- 
tionnaire led to formulation of a syndrome, 
termed alienation, composed of the following 
five interrelated dispositions: egocentricity, 
distrust, pessimism, anxiety, and resentment. 
Our findings indicate that alienated subjects 
are “lone wolves” with grievances, distrust- 
ful of their fellowmen, apprehensive and 
gloomy in their anticipations of the future. 

Empirical examination of five hypotheses 
revealed that, in our sample, individuals who 
are high on this syndrome tend to apperceive 
other people in their social environment as 
more alienated than they really are, yet less 
alienated than themselves. Also, individuals 
who are high on alienation showed a greater 
discrepancy between themselves and the ap- 
perceived average person and between them- 
selves and their ideal person than did indi- 
viduals who are low on alienation. Finally, it 
was found that individuals who view the 
world and their relationship to it in a nega- 


tive light have a weak ego structure as esti- 
mated by experienced clinical judgment. 


Received May 24, 1954. 
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Relationships Between the Rosenzweig P-F Study 
and Test Duration, Socioeconomic 
Status, and Religion’ 


Edward T. Parsons 


Pennsylvania State University 


This study had four aims: to correlate 
Rosenzweig Picture-Frustration Study scores 
with the time taken in answering it; to corre- 
late P-F scores with scores of the Sims Score 
Card for Socio-Economic Status; to investi- 
gate differences between P-F scores of Prot- 
estants and Catholics as a group and in ma- 
jority and minority situations; to compare 
P-F scores of those omitting items of the 
P-F study to P-F scores of the total group, 
and determine the P-F items most often 
omitted and unscorable. 

The Ss were 150 white seniors from four 
Pennsylvania high schools. Each school sup- 
plied a whole class, a class in a course that 
students were required to take, and a class 
to which they had been assigned in a random 
fashion. 

Sims scales were administered first, then 
the P-F study. The time each student used to 
answer the P-F was recorded. Product-mo- 
ment coefficients of correlation were com- 
puted to investigate relationships between 
P-F scores and test duration and between 
P-F scores and socioeconomic status scores. 


1 This report is based upon an M.S. thesis super- 
vised by Dr. William U. Snyder at the Pennsylvania 
State University. 

An extended report may be obtained without 
charge from E. T. Parsons, Children’s Service Cen- 
ter, 335 S. Franklin St., Wilkes-Barre, Pa., or for a 
fee from the American Documentation Institute. To 
obtain it from the latter, order Document No. 4455 
from ADI Auxiliary Publications Project, Photo- 
duplication Service, Library of Congress, Washing- 
ton 25, D. C., remitting in advance $1.25 for micro- 
film or $1.25 for photocopies. Make checks payable 
to Chief, Photoduplication Service, Library of Con- 
gress. 


Need persistence and intropunitiveness cor- 
related positively with test duration, both .24 
(p = .01). Extrapunitiveness correlated nega- 
tively with test duration, — .18 (p = .05). 

Socioeconomic status scores ranged from 2 
to 31, “lowest” to “highest,” according to 
Sims’ provisional levels. The mean was 17, 
“high.” No significant correlation was found 
between socioeconomic status scores and P-F 
scores. 

Catholic/Protestant percentage ratios were 
27/73 and 75/25 in two classes. P-F mean 
scores of these groups were compared to in- 
vestigate differences between Catholics and 
Protestants in minority and majority situa- 
tions. One difference was significant at the 
.05 level, but chance would account for this 
since 28 differences were checked. Comparing 
P-F mean scores of all Catholics to scores of 
all Protestants gave no significant differences. 

P-F mean scores of the 13 Ss who omitted 
one or more P-F responses were compared to 
mean scores of the total sample. Those who 
omitted responses earned higher mean group 
conformity ratings. The difference was sig- 
nificant at the .05 level. 

The number of omitted and unscorable re- 
sponses was less than 2% of all responses. 
Item 19 of the P-F study was most often 
omitted, and 69% of all omissions occurred 
in the second twelve items. Unscorable re- 
sponses were found most often with items 14 
and 20, and 75% of the unscorable responses 
were in the second half of the P-F study. 


Brief Report 
Received October 26, 1954. 














Ce OS 








Journal 4, Consulting Psychology 
Vol. 19, No. 1, 1955 





Organizational Activity on the Rorschach Test’ 


Boyd D. Sisson 
VA Hospital, Omaha, Nebraska 


and Earl S. Taulbee 
Norfolk State Hospital and University of Nebraska College of Medicine 


Organization in Rorschach responses—de- 
fined by Beck as the combination of test fig- 
ures into larger units that may be whole re- 
sponses, details seen in relation to each other, 
or the combination of white spaces with 
filled-in elements—is widely used in the 
evaluation of test protocols. The meaning 
commonly attached to this test activity is as 
an indicator of intelligence or a component 
of intelligence, with the assumption of a direct 
and positive relationship between the amount 
of organization and level of intelligence. The 
literature, however, contains relatively little 
research specific to the assumption involved 
in the common interpretation of the organi- 
zation factor. This paper will report briefly 
some hitherto unpublished findings pertinent 
to this area. It also will provide additional in- 
formation to a published study by Wilson 
and Blake (4) concerning a methodological 
problem in the organizational concept. 

In a recent study involving the Rorschach 
test and the SRA Primary Mental Abilities 
Test with a group of 32 “normal” high 
school students, Batt (1) reported correlation 
coefficients of .49 and .46, both statistically 
significant at the 1% level, between weighted 
Z score and the Verbal and Reasoning por- 
tions of the PMA, respectively. He inter- 
preted these findings as “indicating Z to re- 
late most closely to particular kinds of intel- 
lectual abilities, specifically those involving 
capacity to understand ideas expressed in 
words, to solve logical problems, and to fore- 
see and plan.” 

In another study Taulbee (3) used the 
Rorschach to evaluate the intellectual levels 


1 From the VA Hospital, Omaha, Nebraska. 


of functioning in a group of 60 hospitalized 
schizophrenic patients. He found the Z score 
to have a positive and significant relationship 
with the Full-Scale Wechsler IQ, but that the 
relationship in this group was due almost en- 
tirely to the correlation with three of the sub- 
tests—Digit Span, Similarities, and Vocabu- 
lary. It was concluded from these results that 
among schizophrenic patients the ability to 
organize and see things as a whole seems to 
be related to freedom from distractability, 
the ability to engage in verbal abstraction, 
and the ability for concept formation. 

Similarly, Wishner (5) previously reported 
Beck’s Z to be the most consistently signifi- 
cant of the Rorschach signs as an index of 
intellectual performance for a group of neu- 
rotic patients based on a correlation at the 
1% level of confidence between Z and the 
Full-Scale Wechsler IQ. These two studies 
show a consistency in significant correlations 
of W and Z with Vocabulary subtest scores, 
which offers support for the widely used clini- 
cal hypothesis that vocabulary test scores are 
relatively resistant to the effects of neurotic 
or schizophrenic processes and, therefore, pro- 
vide good estimates of premorbid intellectual 
functioning. 

Based on a group of 50 randomly selected 
psychiatric patients, Sisson and Yager ob- 
tained a correlation of 428 (p <_.01) be- 
tween weighted Z score and Wechsler Full- 
Scale IQ; their data also yielded a correlation 
of .452 between unweighted number of Z re- 
sponses and Full-Scale IQ. Thus, it is seen 
that the above findings are in agreement in 
supporting the validity of the assumption that 
there is a positive relationship between or- 
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Table 1 


Relationship Between Weighted Z Responses and Number of Z Responses 

















Mean Mean 
Age Mean weighted no. of 
Group N range age Z SD Z SD r* 

Normal adults 60 20-52 36.0 24.03 18.32 8.45 5.36 .982 
Normal children 70 8-18 13.4 23.22 19.40 7.71 5.31 .988 
Schizophrenics 60 20-39 27.6 27.38 17.30 9.08 5.17 .976 
Neurotics 35 20-46 31.9 26.87 19.59 9.57 6.14 985 
Organics 10 19-44 32.8 27.50 15.11 8.90 4.01 .983 











* Product-moment correlations between weighted Z scores and number of 7 responses. 


ganization activity on the Rorschach test and 
intelligence. 

As pointed out by Wilson and Blake (4), 
a second assumption involved in the organi- 
zational score aside from its operational va- 
lidity is the technique of scaling organization. 
They reported a study concerned with an 
analysis of the weighting system used by 
Beck in connection with the various types of 
organizational activity. Their results showed 
a “consistent and extremely strong relation- 
ship” between simple summation of responses 
containing Z and total weighted Z scores. 
Their data yielded no product-moment cor- 
relation coefficient smaller than .98 for a 
varied group of 104 subjects, from which they 
conclude that determination of the types of 
organized responses, the weights for each, or 
the sum of weighted Z values contributes 
little more than can be had simply by count- 
ing the number of organized responses. In the 
same report they present a table for predict- 
ing total weighted Z score when number of 
Z responses is known. 

The following study is reported for the pur- 
pose of providing additional data to those of 
Wilson and Blake. 


Study 


The Rorschach protocols of 235 subjects, 
representing five groups, were analyzed to de- 
termine the relationship between the weighted 
Z scores and number of Z responses. All sub- 
jects were males except for the normal chil- 
dren group which consisted of 29 males and 
41 females. The schizophrenic, neurotic, and 
organic subjects were all hospital patients at 
the time of testing; the normal subjects were 





from a small midwestern community? lo- 
cated in the same geographical locale from 
which the patients came. 

Table 1 gives a summary of the calcula- 
tions. Analysis of the data shows that em- 
ploying the table of Wilson and Blake for 
best total weighted Z prediction when total 
number of Z responses is known (which has 
a standard error of 4.74) correctly classified 
the following percentage of cases within one 
and two standard errors, respectively: 83% 
and 97% of the normal adults, 90% and 
99% of the normal children, 73% and 98% 
of the schizophrenics, 71% and 91% of the 
neurotics, and 90% and 100% of the organics. 


Discussion 


Results of the studies presented above sup- 
port the assumption of a direct and positive 
relationship between organization activity on 
the Rorschach test and intelligence. In this 
respect, then, the findings contribute to the 
problem of operational validity of the or- 
ganization factor. There is additional sugges- 
tion that at least with certain groups the re- 
lationship between Z and specific components 
of intelligence is greater than it is with the 
total or generalized intelligence functioning. 
This is viewed as denoting the areas of func- 
tioning which seem to be least affected by the 
schizophrenic process, but it may also be help- 
ful in generating hypotheses as to the specific 
processes involved in the ability—or inability 
—to organize one’s percepts. 


2 The records were from a larger study done un- 
der the supervision of Dr. Marshall R. Jones and 
supported by the University of Nebraska Research 
Council. 
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It is the writers’ opinion that the findings 
concerning the relationship between weighted 
Z scores and number of Z responses show that 
quantitatively the present system of scaling 
the Z responses for the purpose of enhancing 
the differentiating function of this activity is 
of little value. 

When the organization factor is used as a 
single total as its contribution to interpreta- 
tion of the Rorschach test, the findings have 
significance not only in questioning the value 
of the weighting system, but perhaps also in 
the interest of time saving and simplicity. It 
is recognized, however, that the use of Z in 
interpretation is not necessarily confined to 
mere consideration of its total amount, but 
that it probably offers much more when also 
utilized by analyzing its kind, distribution, or 
absence. In other words, the writers feel that 
the rationale for scaling Z according to the 
nature of the organizing activity involved has 
merit, and they certainly do not advocate 
abandoning it but believe that the above find- 
ings show the necessity for further research 
in establishing a more sensitive method of 
scaling. 


Summary 


Results of several unpublished studies are 
reported concerning the relationship between 
the organization factor on the Rorschach test 


and intelligence level. In the main, they sup- 
port the clinical hypothesis of a direct and 
positive relationship, and also present evi- 
dence that the Z activity, at least among cer- 
tain groups, seems to be related most closely 
with certain of the verbal functions in the 
intelligence concept. 

Report is made of a study which yields 
very close agreement with earlier findings by 
Wilson and Blake of a consistent and ex- 
tremely strong relationship between simple 
summation of responses containing Z and 
total weighted Z scores. 


Received May 12, 1954. 
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Psychiatric Screening of Flying Personnel with the 
Cornell Word Form’ 


John R. Barry, Saul B. Sells, and David K. Trites 
Air Force School of Aviation Medicine, Randolph Field, Texas 


The authors elsewhere (1) have summa- 
rized research in progress on the psychiatric 
selection of flying personnel. The present re- 
port describes the development and validation 
for psychiatric screening of a key for the Cor- 
nell Word Form (CWF), a controlled word- 
association test. This test was one of twelve 
experimental personality tests administered to 
1,036 cadets entering pilot training at Ran- 
dolph Air Force Base in 1949 and 1950. None 
of these cadets was excluded from training on 
the basis of his test responses. 

Three scoring keys were selected for valida- 
tion. Subsequently, the most efficient key was 
cross-validated with significant results in three 
independently selected, but overlapping, sam- 
ples, selected to define different, but related, 
criteria of adjustment. In the first cross- 
validation sample, cadets who resigned from 
training were considered the lower criterion 
group members (V = 128); cadets who com- 
pleted primary flying training (NV = 301) or 
who were eliminated because of flying inapti- 
tude (NV = 210) were included in the upper 
criterion group. When the key was applied to 
the test responses of these three groups, 14 
per cent of the resignee group (true negative) 
and less than 8 per cent of the other two 
groups (false negative) were identified as po- 
tentially unfit. A significantly larger propor- 


1An extended report of this study may be ob- 
tained without charge from John R. Barry, USAF 
School of Aviation Medicine, Randolph Field, Texas, 
or for a fee from the American Documentation In- 
stitute. To obtain it from the latter source, order 
Document No. 4452 from ADI Auxiliary Publications 
Project, Photoduplication Service, Library of Con- 
gress, Washington 25, D. C., remitting in advance 
$2.50 for microfilm or $6.25 for photocopies. Make 
checks payable to Chief, Photoduplication Service, 
Library of Congress. 





tion of the resignees than of the other two 
groups was identified (p < .03). 

In a second study, criterion status was 
based upon psychologists’ over-all ratings of 
adjustment to flying training rather than upon 
training outcome alone. Cadets who failed and 
who were given low ratings were assigned to 
the lower criterion group (N = 309). The 
upper criterion group (N = 392) included 
cadets who were judged to have adjusted to 
flying better than this lower criterion group. 
As was predicted, a significantly larger pro- 
portion of the lower than of the upper cri- 
terion group (11 and 7 per cent respectively) 
made three or more unhealthy test responses 
(p < .04). 

In a third study, a stratified sample was 
selected to represent the total population with 
reference to the adjustment ratings and pass- 
fail status. However, only the ratings were 
used in the criterion. When these ratings 
were dichotomized at their mean, a signifi- 
cantly larger proportion of those below than 
of those above the mean (13 and 4 per cent 
respectively) was identified by CWF re- 
sponses (p < .02). 

It appeared from this research that a small 
but significant number of the cadets who ad- 
just poorly to flying training can be identi- 
fied by their responses to the CWF. In 
these responses the cadets seem to express 
certain fears, dissatisfactions, and psycho- 
somatic symptoms. 


Brief Report 
Received October 22, 1954. 
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Threshold for the Perception of Human Movement 
in Inkblots’ 


Frank Barron 


Institute of Personality Assessment and Research, University of California, Berkeley 


One of the variables conceptualized and 
scored as part of the Rorschach Psychodiag- 
nostic (7) is the tendency of the subject to 
perceive human beings, or human-like animals, 
engaged in characteristically human activity 
in the blots (the M response). This response 
tendency is said to go along with a bent to- 
ward introversion rather than extraversion. 
Introversion has been variously defined; in 
general, it may be conceived of as a tendency 
to take thought rather than action, to ex- 
perience vicariously and in fantasy rather 
than in real life and directly, and to create 
through the arrangement of symbols rather 
than through the arrangement of objects 
which stand for nothing but themselves. 

The aim of the present investigation was to 
study the personality correlates of the human 
movement response tendency in a research 
situation which would make it possible to ob- 
tain independent evidence concerning the per- 
sonalities of the subjects. Such a situation is 
provided by the living-in assessment method, 
with its emphasis upon observation of the sub- 
jects through several days of informal social 
interaction, lifelike situational tests, group 
discussions, improvisations, group games, and 
the like. This makes it possible to discover 


1 This research is supported in part by the United 
States Air Force under Contract No. AF 18 (600)-8, 
monitored by Technical Director, Detachment No. 7 
(Officer Education Research Laboratory), Air Force 
Personnel and Training Research Center, Maxwell 
Air Force Base, Alabama. Permission is granted for 
reproduction, translation, publication, use, and dis- 
posal in whole and in part by or for the United 
States Government. Personal views or opinions ex- 
pressed or implied in this publication are not to be 
construed as necessarily carrying the official sanction 
of the Department of the Air Force or of the Air 
Research and Development Command. 
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how persons who have much or little’ readi- 
ness to perceive human movement in inkblots 
are described by skilled psychological ob- 
servers who become acquainted with them but 
not with their test scores. 


The measure of readiness to perceive human move 
ment in inkblots was especially constructed for this 
study, and represents an attempt to supplement the 
Rorschach test itself as an instrument of observation 
when Rorschach theory is in question. As users of 
the test know, the Psychodiagnostic is very com- 
plex, both stimulus-wise and in its scoring scheme, 
and it does not lend itself well to any attempt to 
isolate variables and to separate out their correla- 
tional components. While this complexity is impor- 
tant to the test as a vehicle for clinical observation, 
it contributes to certain psychometric shortcomings 
and unnecessary difficulties when the verification of 
theory is the chief concern 

One important difficulty with the scoring scheme 
is that the number of responses varies widely for dif- 
ferent subjects. Productivity is itself an important 
variable, of course, but the present method of ob- 
taining a measure of it tends to confound the evalua- 
tion of other measures which may be equally impor- 
tant. Subjects now cannot be compared in terms of 
absolute incidence of a given type of response, since 
this is partly a function of total number of responses. 
Furthermore, subjects cannot be compared in terms 
of relative incidence, for relative incidence of re- 
sponse in a given category varies in some nonlinear 
and as yet undetermined fashion with total number 
of responses. This in turn is dependent to some ex- 
tent on stimulus properties of the blots; there is 
clearly a limitation to the number of responses which 
can be given in any single category, and after a cer- 
tain point in the production of responses the more 
limited categories begin to suffer relative the 
others. 

What is needed, then, is a method of keeping the 
number of responses more or less constant for all 
subjects, while yet providing considerable opportu- 
nity for the subject’s response tendencies to emerge 
At the same time, stimulus strength should be 
weighted properly in evaluating response strength; 
one difficulty with the Rorschach measure of M tend- 


to 
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ency is that it is a simple count of the number of 
human movement percepts which are verbalized by 
the subject, without regard for the power of the 
stimulus to evoke a human movement response in 
the average person. 

Some of the difficulties may be met if these pre- 
scriptions are followed: (a) increase the number of 
blots; (b) score only one response, the first, to each 
blot; (c) take systematic account of the relationship 
between stimulus strength and response tendency by 
employing the conventional experimental index of 
this relationship, response threshold; (d) isolate the 
main Rorschach variables and study them one at a 
time before attempting to study them all together. 

The rationale of these prescriptions is simple and 
clear. An increase in the number of blots should 
achieve more representativeness on the stimulus side 
and more total-score reliability (since reliability may 
be increased, up to a point, by increasing test 
length). Scoring of only one response to each blot 
makes the absolute number of responses in each 
scoring category comparable from subject to subject, 
and makes feasible the use of some sort of standard 
score, such as Z scores, so that the individual sub- 
ject’s performance may be immediately referred to 
that of the general population.2? The weighting of 
stimulus strength in evaluating response strength is 
essentially a more differentiated way of scoring, com- 
parable to the use of refined rather than crude 
weights in prediction; the addition of the concept 
of threshold makes the human movement phenome- 
non more assimilable to established knowledge and 
methods in experimental psychology, which is all to 
the good so far as Rorschach theory is concerned. 
Finally, the study of variables in isolation, however 
unholistic it may seem, may really be the best pos- 
sible foundation for the understanding of variables 
in interaction. 


In the present study, then, the variable 
under consideration is threshold for percep- 
tion of human movement in inkblots; the aim 
of the study is to construct a measure of 
threshold and to ascertain its personality 
correlates; the general method of personality 
research employed is the living-in assessment 
method. 


Construction of the Measure of Threshold 


The model for the construction of a meas- 
ure of threshold for perception of human 


2It might be pointed out incidentally that Ror- 
schach ratios, such as M:Sum C, may be much more 
meaningful if they are ratios of Z scores rather than 
absolute scores; Z ratios would be free of the often 
unrecognized and cumbersome assumption underlying 
absolute score ratios, viz., that the blots themselves 
present precisely equal opportunity for the two con- 
trasting experience-types, introversive and extraten- 
sive, to manifest themselves. 


movement is the conventional stimulus series 
used to determine response thresholds in such 
sense modalities as the auditory, olfactory, 
tactile, and the like. Although stimulus strength 
or intensity is not determinable from physical 
properties of the stimulus in the case of ink- 
blots, this is no great loss so long as relative 
frequencies of response can be established in 
large samples and with some stability. By 
arranging inkblots of known relative fre- 
quency in a regularly graduated series, with p 
values ranging from .00 to 1.00, a measure 
analogous to the usual perceptual stimulus 
series is constructed. The subject’s threshold 
for human movement is then the ordinal posi- 
tion of that blot in the series at which he first 
gives a human movement response. 

This ideal design was not carried out ex- 
actly as projected in the present study, 
largely because of time pressures in the sched- 
uling of the assessments. One hundred and 
fifty achromatic inkblots had been constructed, 
using 4- by 6-inch sheets of white paper, which 
were then mounted on stiff cardboard of the 
same dimensions. The plan had been to select 
26 blots from the 150, on the basis of ob- 
served frequencies, in such a manner as to 
make a series with graduations of approxi- 
mately .04. It became necessary, however, to 
select the blots on the basis of observations 
in a small preliminary sample, and to order 
them initially in terms of observed frequencies 
in that sample. For this reason, the threshold 
score finally assigned to the assessed subjects 
was based on the relative frequency of M 
response to each blot im the assessed sample 
itself. This design is somewhat inferior to 
what was first intended, but it still fills the 
prescriptions specified for construction of a 
measure which would overcome some of the 
difficulties inherent in the Rorschach measure 
of M tendency. 

As it turned out, the preliminary standard- 
ization yielded a fairly stable stimulus series. 
The rank-difference correlation between the 
order of presentation based on frequencies in 
the preliminary standardization group and the 
final ordering of the blots in terms of fre- 
quencies observed in the assessed sample is 
85. The stability of the final ordering of the 
blots in the rather homogeneous Air Force 
officer sample is indicated by the rank-differ- 
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ence correlation between a rank order based 
on observed frequencies in the first 50 cases 
and a rank order based on observed fre- 
quencies in the final 50 cases: rho is .99. 
For this homogeneous sample, the M-evoca- 
tive power of inkblots is remarkably stable. 

The possible range of scores for individual 
subjects is, of course, from 1 to 27 (the score 
of 27 being assigned to subjects who do not 
see M in any one of the 26 blots). The ex- 
pected range, considering the method of con- 
struction of the measure, is from 2 (since no 
subject should see M on the first blot) to 26. 
The actual observed range was from 2 to 25, 
with the mean at 13. The form of the distribu- 
tion was approximately rectangular. 


The Sample and the Method of Study 


The subjects in this study were 100 captains 
in the U. S. Air Force. As a group they were 
above average in intelligence, in education, in 
physical health, and in personal stability. The 
age range was from 27 to 50, with a mean age 
of 33. All of the subjects were men. All but 
three were married, and most of them had at 
least two children. In pre-army socioeconomic 
background they tended to be lower middle 
class. The majority of these officers were com- 
bat veterans, and many of them had been 
decorated for valor in World War II. In most 
ability measures they scored well above aver- 
age, and were less variable than men-in- 
general. 

The subjects were seen in groups of ten for 
three full days at the Institute house. The 
method of study placed considerable emphasis 
upon observation of the subjects in informal 
social interaction. The assessment staff psy- 
chologists sat down to meals with the sub- 
jects, took part in a social hour before dinner, 
and in general were participant observers 
throughout the three days of living-in assess- 
ment. Situational tests, interviews, group dis- 
cussions, improvisations, charades, and the 
like were included in the assessment program, 
so that the social characteristics of the sub- 
jects had much opportunity to manifest them- 
selves, and the raters were in a position to ob- 
serve significant behavior. 
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Observations made by staff members during the 
three days of study were condensed and rendered 
easily susceptible of statistical analysis chiefly 
through two techniques: a set of 76 statements de- 
scriptive of personal functioning and permitting the 
expression of clinical inferences, and an adjective 
check list (3) consisting of common, personally de- 
scriptive adjectives. Both techniques were used by 
staff members at the conclusion of the three days 
of assessment to sum up their impressions of each 
subject. 

The 76 statements were sorted on a 9-point scale 
(a so-called Q sort), the frequencies at each point 
being such as to make the final distribution conform 
closely to the normal curve. The 300 adjectives 
were checked simply as characteristic or not charac- 
teristic of the given subject. The Q-sort composite 
was obtained by averaging the placements of the 
items by four staff members, and then redistributing 
these averaged values on a normal curve. The ad- 
jective composite consisted of all adjectives which 
had been checked as characteristic of a subject by 
three or more raters. 

These descriptions and ratings were of course given 
without knowledge of the objective test perform- 
ances of the subjects. No rater knew the M thresh- 
old of any of the subjects at the time the ratings 
were made. 

In addition to these descriptions based on social 
observation of the subjects, information is available 
concerning life-history factors. Each subject was 
interviewed for two hours by a psychiatrist or clini- 
cal psychologist (who did not otherwise participate 
in the assessment), and again a check-list method 
was used to summarize impressions from the inter 
view. The life-history check list contained sections 
having to do with the subject’s recollection of him 
self as a child, his imagery of his parents, his fa 
vorite games, his playmates, and so on. 

Finally, certain objective test measures were ob- 
tained on all subjects. These included measures of 
general intelligence, of originality, of personal sta 
bility, and of social attitudes. Scores from all of 
them were available for correlation with M threshold 


Correlates of M Threshold 


It should be remembered, of course, that 
high scorers on the threshold measure are 
those with less readiness to perceive human 
movement; lower threshold means greater 


disposition to give an M response. 

The observer adjective descriptions which 
are significantly (.05 level) related to thresh- 
old for M when the first quartile of the dis- 
tribution (threshold scores from 2 to 8) is 
compared with the fourth quartile (threshold 
scores from 18 to 25) are as follows: 
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Early M response (low threshold) 
intelligent 
fair-minded 
mild 
anxious 
mannerly 
inventive 
interests wide 
Late M response (high threshold) 


practical 
stubborn 
simple 
masculine 
arrogant 


The composite Q-sort descriptions yielded 
the following items with significant (.05 
level) differences between the groups: 


Early M response (low threshold) 


1. Highly cathects intellectual activity; values cog- 
nitive pursuits. 

2. Gets along well in the world as it is; is socially 
appropriate in his behavior. 

3. Is introspective; concerned with his self as ob- 
ject; frequently self-aware. 

4. Has high degree of intellectual ability. 


Late M response (high threshold) 


1. Has narrow range of interests. 

2. Allows personal bias, spite, or dogmatism to enter 
into his judgment of issues. 

3. Prefers action to contemplation. 

4. Is rigid; inflexible in thought and action. 


At this point, an important discrepancy be- 
tween observers’ descriptions and actual test 
measures should be noted. Although subjects 
with greater M tendency were described as 
inventive, intelligent, and broader in their in- 
terests, correlations between M threshold and 
actual measures of intelligence, general in- 
formation, and originality in problem solving 
were all in the neighborhood of zero. The 
aptitude tests used included the Terman Con- 
cept Mastery Test,® the Wesman Personnel 
Classification Test (9), the Arthur Stencil 
Design Test (1), the Idea Classification Test,’ 
and the Test of Mechanical Comprehension 
(2). A 180-item General Information Survey 


8 For a general description of the form of this 
test, which is as yet unpublished, see Terman and 
Oden (8). The test was made available through 
the generosity of Dr. Terman. 

* Acknowledgment is made to Educational Testing 
Service for making this test available prior to its 
publication. 


constructed by Gough (4) was also employed. 
Several tests from the Guilford Creativity bat- 
tery (6), including the Unusual Uses, Plot 
Titles, Consequences, Match Problems, Gestalt 
Transformation, and Controlled Association 
tests, were used; none showed a significant 
relationship to M threshold. The failure to 
find such relationships occurred both when 
M threshold was correlated with these meas- 
ures for the entire 100 cases, and also when 
the first quartile on M was compared with 
the fourth quartile. 

What these facts plainly say is that sub- 
jects with greater readiness to perceive M ap- 
pear to psychological observers to be more 
intelligent, more inventive, and broader in 
their interests in social situations, but that in 
controlled testing situations, when problem- 
solving activity is called for, M threshold is 
unrelated to test scores. If we assume the 
validity of the test measures, the most direct 
explanation of the discrepant adjective and 
Q-sort descriptions would seem to be that 
psychologists falsely attribute greater intel- 
ligence to persons who manifest more tendency 
to introspect, to take thought rather than to 
take action. A check on this hypothesis seems 
to support it: the Q-sort item “Has a high de- 
gree of intellectual ability” correlates .45 with 
the item “is introspective; concerned with his 
self as object; frequently self-aware.” The 
latter item, however, correlates only .11 with 
the Arthur Stencil Design Test, .02 with the 
Idea Classification Test, .26 with the Wesman 
Personnel Classification Test, and .27 with 
the Terman Concept Mastery Test. Intro- 
spection thus appears to be weighted unduly 
by the psychological staff in judging intel- 
ligence. Perhaps, after all, the more “thought- 
ful” person is not always the more intelligent 
person, thoughtfulness being an intellectual 
disposition rather than an intellectual ability. 


Some evidence concerning developmental factors re- 
lated to M tendency is furnished by the life-history 
interview material. The subjects with low thresh- 
olds for M described themselves significantly (.05 
level) more often as quiet and self-conscious during 
their childhoods. They were also less interested in 
sports, and took less part in rough-and-tumble play, 
than high-threshold subjects; the latter more often 
described themselves as having been active, and 
characterized their childhood as happy 
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There are some possibly related differences be- 
tween the two groups of subjects in their descrip- 
tions of their mothers: the adjectives showing dif- 
ferences significant at the .05 level are nervous, pro- 
tective, conservative, punishing, and worrying, all of 
them being more characteristic of the mothers of 
low-threshold subjects. The general picture we get 
from the life-history interview material is that the 
person who in adulthood has more disposition to see 
human movement in the inkblots was in childhood 
somewhat shy, sensitive, and overprotected, or even 
maternally dominated. In relation to this, it is of 
interest that the Femininity key of the California 
Psychological Inventory (5) correlates — .26 with 
M threshold (the more M-disposed subjects obtain- 
ing higher femininity scores). 


In brief, readiness to see human movement 
in the inkblots seems to go along with intro- 
spectiveness, thoughtfulness, fair-mindedness 
(suggesting ethical discrimination based on 
cognitive principles), and a high valuation of 
the intellectual processes, based perhaps upon 
a certain inhibition of activity and greater re- 
course to fantasy in childhood. Such persons 
are seen in adulthood as relatively mild, 
mannerly, and even anxious as compared with 
the practical, masculine, and simple individuals 
who have less tendency to see movement in 
the blots. It appears too that an extreme lack 
of M tendency may at times be nonadaptive: 
the Q-sort items “is rigid; inflexible in thought 
and action,” and “allows personal bias, spite, 
or dogmatism to enter into his judgment of 
issues” point clearly to the kinds of liabilities 
which accompany the static perceptual at- 
titude. This is seen as issuing on occasion in 
stubbornness and arrogance. 


Discussion 


Rorschach’s claim that movement responses 
are produced most abundantly by persons who 
“function more in the intellectual sphere, 
whose interests gravitate more towards their 
intrapsychic living rather than towards the 
world outside themselves” (7, p. 64), seems 
in general to be supported by these findings. 
In a sense, the fact that M threshold is un- 
related to measured intelligence strengthens 
rather than weakens this conclusion. If two 
groups of subjects are equal in intelligence, 
but one group is characteristically described 
as more intelligent, more introspective, more 
concerned with intellectual activity, and more 
given to contemplation than to action, then it 


seems fair to say that these latter individuals 
“function more” (not necessarily better) in 
the “intellectual sphere.” 

Rorschach himself, of course, thought of 
this tendency as “a component of intelligence” 
(7, p. 63). The production of many move- 
ment responses is, he claims, one of the char- 
acteristics of “intelligent subjects.” Since this 
observation was based upon his own estimates 
of his subjects’ intelligence, it may be that he 
was misled by the same occupational prejudice 
displayed by the psychologists of the staff of 
this Institute. (Rorschach was not above in- 
jecting his own biases rather freely into his 
experimental observations, as witness his en- 
tertaining preoccupation with “pedants” and 
“grumblers,” two diagnostic categories which 
appear more frequently in the Psychodiag- 
nostic than would seem warranted by ordi- 
nary nosological usage. ) 

In some ways, it seems preferable, from a 
psychological assessment standpoint, to have 
a well-defined and measurable variable which 
is entirely stylistic in character and free of 
correlation with measures of general ability. 
Where style is important in effectiveness of 
performance, such variables may add more to 
a prediction equation than do variables which 
are loaded with intelligence factors. This is 
especially true where personal interaction is 
concerned, and where certain combinations of 
styles of performance work better than others. 
Two-person situations with subjects selected 
especially for similarities or differences of 
style offer interesting possibilities for tests of 
hypotheses concerning the conditions which 
make for constructive and empathic interac- 
tion versus those which make for destructive, 
stultifying relationships. Rorschach suggests, 
for example, that a person with strong intro- 
versive tendencies can hardly be understood 
at all by a person whose bent is strongly ex- 
tratensive; with adequate measures of such 
tendencies in perception, experimental verifica- 
tion of such a hypothesis would not be dif- 
ficult. 

The present measure of M threshold is as 
yet in a preliminary stage of development. It 
is evident that Guttman scale analysis is made 
to order for the psychometric goal of accurate 
placement of an individual in relation to 
others on such a dimension as M tendency. 











38 


It seems quite possible that other Rorschach 
factors could be equally well measured, and 
that a series of separate tests could be pro- 
duced which would be much better, from 
the point of view of perception theory and 
research, than the instrument with which 
Rorschach made his initial observations. He 
himself, of course, was quite open to such in- 
novations, and indeed suggested a number of 
interesting possibilities in his classical mono- 
graph. 


Summary 


A measure of threshold for the human 
movement response was constructed by ar- 
ranging inkblots of known M-evocative power 
in a regularly graduated series. The final 
series consisted of 26 blots, selected from a 
group of 150 blots for which the relative fre- 
quency of M response was known. The sub- 
ject’s threshold score, based on the final ar- 
rangement of the 26 blots, was given by the 
ordinal position of that blot in the series at 
which he first verbalized a human movement 
response. 

The correlates of M threshold were studied 
in a sample of 100 military officers who took 
part in three days of living-in assessment, and 
who had been described by staff psychologists 
through the use of Q-sort and adjective check- 
list techniques. The psychologists did not, of 
course, know the M threshold scores of the 
subjects. It was found that M threshold was 
uncorrelated with measures of intelligence, 
originality, and associational fluency, but that 
subjects who displayed considerable readiness 
to give human movement responses were con- 
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sidered by staff psychologists to be more in- 
telligent, inventive, introspective, contempla- 
tive, and the like. The conclusion was that 
the human movement tendency is a stylistic 
variable, and that it does indeed relate, as 
Rorschach thought it did, to a preference for 
“intrapsychic living” as opposed to interest in 
action, practical affairs, and “the world out- 
side.” 


Received May 20, 1954. 
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A study to define the nature and extent of 
changes which occur as a result of the opera- 
tion of prefrontal lobotomy revealed certain 
significant changes in lobotomized chronic 
schizophrenics following a three-month in- 
terval (2, 3). These changes were in part 
measured by scores on 11 factors based on 
clinical judgments made on an extensive rat- 
ing schedule (4, 7). 

Subsequently, the correlations between the 
11 preoperative factor scores of 153 of the 
patients selected for lobotomy and _ their 
matched controls were factor analyzed (5). 
The analysis was undertaken in the hope of 
securing a more satisfactory conceptual dif- 
ferentiation of the major schizophrenic proc- 
esses than is presently available. Three “sec- 
ond-order” factors were identified and related 
to those reported in previous studies. Factor 
Alpha was interpreted as a bipolar parameter 
of apathetic withdrawal with motor disturb- 
ances versus an agitated excitement. Beta 
was regarded as a factor of distortion and 
disorganization in thinking and perception. 
Gamma described a fighting reaction which 
was called belligerence. 

The scaled clinical judgments as repre- 
sented in the 11 factor scores indicated that 
there was favorable change in both lobotom- 
ized and control groups at the end of a three- 
month period. However, the degree of favor- 
able change was significantly greater for the 
operated patients on certain of the factor 
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scores. A number of questions arose as to the 
nature of the changes in the operated pa- 
tients and their controls. Can change best be 
described in terms of a single general factor 
of reduced pathology or in terms of several 
group factors? If change can be described in 
terms of several factors, are these the same 
as those originally identified in the analysis of 
the preoperative scores? Furthermore, are the 
change factors the same in the operated and 
nonoperated groups? If they are similar, then 
the findings of greater change in the operated 
patients would suggest that lobotomy simply 
quickens or stimulates the normal process of 
recovery. Isolation of different factors in the 
two groups would imply the development of 
new patterns or the production of adverse ef- 
fects or compensatory defects. 

In order to throw light on these questions 
two parallel factor analyses were undertaken, 
one of changes in lobotomized patients, and 
one of changes in control patients. The vari- 
ables used were the changes in 11 factor 
scores obtained over a three-month interval. 


Procedure 


The patients were 250 chronic male schizo- 
phrenics at six Veterans Administration hos- 
pitals. They had been ill for a period of four 
years or longer. Of the 250 patients, 125 were 
selected from among a group who were loboto- 
mized and 125 were from a group selected to 
serve as controls. 
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The data consisted of clinical judgments The 11 factors scored may be identified by 
reco@led on a schedule of 81 brief descriptive the name and letter that follows: 
ratir& scales (7). The interview section of the 


: - A Retarded depression versus manic excitement 
schefule co: sisted of 46 scales which were 


B Compliance versus resistiveness 


comjfleted following a one-hour diagnostic in- C Paranoid projection 
tervitw by a psychiatrist or psychologist. The D Activity level 

ward section consisted of 35 scales filled out E Melancholy agitation 
by 2 psychologist upon the basis of informa- y Teepe Coneien 


G Motor disturbances 
H Submissiveness versus belligerence 
I Aggressive social activity versus social with- 


tion .secured by interviewing nurses or at- 
tendants who knew the patient well. The 


schecule itself was designed to record in rela- drawal 
tively objective form characteristic behavior J Self-depreciation versus grandiose expansiveness 
and symptoms observable in an interview or K Conceptual disorganization 


on a hospital ward as well as certain items 
descriptive of hospital adjustment. 

Initial ratings were obtained prior to the 
operation on patients later lobotomized and 


on patients selected to serve as controls. relations were computed separately between the 
Three months following the initial descrip- 11 factor change scores of the 125 lobotomized 
tion the same patients were again interviewed patients and the 125 controls. 
and rated. The 11 X 11 correlation matrix of the op- 
The 11 initial and three-month postopera- erated patients’ change scores was factored 
tive scores computed for each patient were by the centroid procedure with the highest 
based on 11 factors previously identified in a correlation coefficient in the column utilized 
multiple-factor analysis of the rating schedule as the communality estimate. The communal- 
(6). Each score consisted of the sum of the ities obtained were reinserted in the matrix 
ratings received by a patient on the group of which was again factored. The mean ab- 
scales best defining a factor. For example, the solute fourth factor residual was then .04 as 
paranoid projection factor C consisted of the compared with the standard error of .064 of 
sum of the ratings on scales descriptive of a zero correlation coefficient. 


Each patient’s change score, based upon the 
difference between his initial and his three- 
month postoperative factor score, constituted 
the basic data for our analysis. Pearson cor- 


ideas of reference, delusions of persecution, The correlation matrix of the control pa- 

delusions of influence, and frequency of as-_ tients’ change scores was factored with cen- 

saults. troid estimates of the communalities in the 
Table 1 


Correlations Between Eleven Change Scores of 125 Operated and 125 Nonoperated Schizophrenics 
(Matrix for operated patients above diagonal; matrix for controls below diagonal.) 




















Factor 

scores A B C D E F G H I J K 
A 01 08 27 55 06 15 07 —35 17 —03 
B 00 38 26 —04 43 41 26 01 37 48 
Cc 17 —03 29 13 50 42 53 —05 25 43 
D 20 —16 04 32 33 25 27 —09 23 19 
E 34 —09 —02 15 07 14 21 —12 13 07 
F 11 06 49 08 —06 27 43 —02 40 51 
G 19 26 38 01 07 57 44 36 41 53 
H 26 33 21 O4 15 13 29 —08 59 31 
I —12 08 08 — 33 —03 08 14 —11 02 10 
J 21 18 29 04 —03 21 29 44 —03 47 
K —04 13 37 —04 —09 57 53 06 01 17 
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Table 2 


Centroid Factor Matrices F, (Operated Group) and F, (Control Group) 





F, 
Factor . . ae ree ’ 
scores I II Ill IV hy 
A 40 —67 19 —03 65 
B 54 29 —09 16 41 
Cc 62 18 —25 15 51 
D 49 —15 —07 17 30 
E 39 — 54 22 08 50 
F 62 22 —24 12 50 
G 60 36 44 14 70 
H 69 18 —12 —34 64 
I —10 43 37 23 38 
J 62 20 12 -30 53 
K 60 39 11 17 55 
Sum of 
squares 3.20 1.47 59 Al 5.67 


diagonals. Four factors were again found to 
be sufficient. The mean absolute fourth factor 
residual was .03. The two matrices are shown 
in Table 1. The rotations were oblique with 
the object of attaining simple structure. 


Results 


The centroid factor matrices F, and F. for 
the operated and control groups are shown in 
Table 2. To facilitate comparisons the rotated 
factor matrices V, and V, are also presented 
together in Table 4. 

Except for factor J the first centroid is 
positive and particularly prominent for the 
lobotomized group. Implied here is a general 
factor of “improvement” in the sense of re- 
duced pathology. When schizophrenic patients 
improve, they tend to improve in all areas. 
Table 3 presents the mean preoperative and 
mean postoperative factor scores for the two 
groups. The changes are nearly all in the di- 
rection of less severe symptoms and less devi- 
ant behavior. The increase in mean score for 
the operated patients on factor A, retarded 
depression versus manic excitement, implies 
movement in the direction of reduced depres- 
sive ratings. 

Although the mean A score of the controls 
is virtually unchanged, the median score in- 
creases from 20.9 to 21.6. However, the factor 
of aggressive social interest versus social with- 
drawal (J) shows no change for the control 


F, 

I Il Il IV hy 
42 — 37 11 29 41 
19 15 43 —33 35 
49 24 —11 11 32 
24 — 38 — 38 10 36 
16 33 14 36 28 
60 47 24 16 66 
67 40 16 13 65 
55 — 23 37 —26 56 

—11 38 34 25 33 
50 —(07 15 21 32 
49 53 21 —10 58 

2 15 ] 33 i3 57 4 82 


group either in central tendency or in the 
shape of the distribution. 

The first factor A, in Table 2 of the op- 
erated group is characterized by motor dis- 
turbances (G), withdrawal (/), and con- 
ceptual disorganization (K). Reduction in 
this factor appears to relate to reduction in 
tendencies toward a catatonic-like withdrawal. 

The A, factor of the control group is de- 
fined by withdrawal (/), motor disturbances 
(G), and a negative projection from overac- 


Table 3 


Preoperative and Postoperative Mean Factor 
Scores of 125 Lobotomized and 125 
Control Schizophrenics 


Lobotomized group Control group 


Pre- Post- Pre Post 


Factor operative operative operative operative 

scores mean mean mean mean 
A 21.1 22.6 21.7 21.4 
B 7.4 5.9 6.3 6.1 
C 12.1 9.5 11.2 10.6 
D 12.8 12.4 12.3 12.1 
E 20.7 20.0 20.4 20.2 
F 12.1 10.0 11.3 10.4 
G 18.1 15.4 17.1 16.1 
H 11.9 9.8 10.6 10.1 
I 18.5 17.1 17.8 17.6 
J 14.7 13.5 13.8 12.8 
K 21.2 18.9 20.8 19.1 
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Table 4 


Rotated Oblique Factor Matrices 
V. (Operated Group) and V, (Control Group) 


Vo 


Factor A. B, 
Manic excitement 1 02 71 
Resistiveness B 15 —O1 
Paranoid projection Cc 02 00 
Overactivity D 01 29 
Melancholy agitation E 08 66 
Perceptual distortion F 00 03 
Motor disturbances G 64 24 
Belligerence H 05 04 
Withdrawal 53 07 
Grandiose expansiveness J 17 06 
Conceptual disorganization K 37 05 


tivity (D). Represented here, then, is a re- 
duction of withdrawal behavior and an in- 
crease in motor activity. If A, and A, may be 
regarded as the same factor, this would sug- 
gest that recovery from the picture of cata- 
tonic withdrawal is more clearly associated with 
an increase of activity in the unlobotomized 
patient, while in the patient who has been 
lobotomized it is more associated with a re- 
duction of conceptual distortion. 

The factors B, and B, appear to represent 
schizophrenic excitement. Factor B, is defined 
by excitement (A) and melancholy agitation 
(£). Factor B, is defined primarily by excite- 
ment, agitation, and motor disturbances. These 
two factors represent a reduction in schizo- 
phrenic excitement. Again, if we assume that 
B, and B, represent the same process, then 
schizophrenic excitement in control cases is 
more clearly associated with diminution in 
motor disturbances. 

Factor C, is characterized primarily by 
paranoid projection (C), perceptual distortion 
(F), resistiveness (B), overactivity (D), and 
conceptual disorganization (K).C, is also de- 
fined by perceptual distortion (F), paranoid 
projection (C), and conceptual disorganization 
(K). However, the projection of conceptual 
disorganization is substantially larger; and 
motor disturbances (G) is also prominent. 
Factor C, may represent a reduction in para- 
noid projection. Factor C. seems to involve a 
more general reduction in disorganization and 


Vs 
Ge D 4 B, Cs D 
06 04 03 49 06 09 
41 01 27 02 (02 55 
52 01 01 22 53 04 
33 OR 47 05 06 16 
01 03 07 45 07 05 
50 03 02 22 RO) 05 
09 17 28 41 65 26 
14 49 02 20 00 65 
07 OR 55 26 13 04 
01 49 0S 11 16 45 
32 OR 01 02 (9 09 


distortion of perception, thinking, and motor 
activity than C,. 

Factor D, appears to represent a grandiose 
belligerence. In the operated group, this factor 
is defined by submissiveness versus belliger- 
ence (//) and self-depreciation versus gran- 
diose expansiveness (J). Factor D, has in ad- 
dition a reduced resistiveness (B). In control 
patients, therefore, the reduction in belliger- 
ence includes a shift in the direction of co- 
operation. 

Table 5 presents the direction cosines be- 
tween the reference vectors in the two analy- 
ses. Both matrices suggest two more general 
groupings. However, as a minimum of five 
variables is required to isolate two factors, 
the correlations between the primaries were 
not computed or factored. For the operated 
group paranoid distortion C, and grandiose 
belligerence D, jointly improve and represent 
a reduction in the fighting reaction and in 


Table 5 


Direction Cosines Between Reference Vectors 
(Cosines for V, above diagonal; cosines 
for V, below diagonal.) 








Factor A B Cc D 








Withdrawal A 10 53 06 .16 
Schizophrenic excitement B 38 100 25 —07 
Thinking disorganization C —.24 —.08 1.00 —.18 
Grandiose belligerence D —.01 —.19 —64 1.00 
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paranoid reality distortion. In the control 
group reduction in catatonic-like withdrawal 
(A,.) and reduction in schizophrenic excite- 
ment (B,) are negatively associated. 

It is also of some interest to relate the 
factors here identified to those found in previ- 
ous studies. A factor analysis of the correla- 
tions between the 11 preoperative factor 
scores of 153 of the patients included in the 
present study resulted in the identification of 
three second-order factors, Alpha, Beta, and 
Gamma, described earlier in this report (5). 
Alpha was interpreted as a bipolar factor of 
apathetic withdrawal with motor disturbances 
versus excited agitation. Alpha appears to be 
represented by two change factors. It is the 
authors’ hypothesis that reduction in catatonic- 
like withdrawal resulted in factors A, and A,. 
Reduction in excited agitation resulted in the 
change factors B, and B,. 

Beta of the preoperative analysis (5), X 
identified by Degan (1), and BB identified 
by Lorr, Jenkins, and O’Connor (6) are simi- 
lar to the factors of disorganization and dis- 
tortion in thinking and perception C, and C,. 
Factors D, and D. (grandiose belligerence) 
of the present study correspond closely to 
Gamma and identify a fighting reaction. 


Summary 


The study was undertaken for the purpose 
of throwing light on the nature of changes 
resulting from prefrontal lobotomy and routine 
hospital care on chronic schizophrenic pa- 
tients. Questions were raised as to whether 
(a) the favorable changes occurring over an 
interval of three months could be accounted 
for by one factor or several; (5) the changes 
resulting from lobotomy and hospital care 
were similar or different; (c) the change fac- 
tors identified were similar to or different 


from those originally isolated in the same 


population sample. 

The correlations between 11 change scores 
in 125 lobotomized schizophrenic patients and 
125 control schizophrenic patients were in- 





dependently factored. The change scores were 
obtained on the basis of preoperative and 
three-month postoperative ratings on a fac 
tored set of 81 rating scales 

Four closely similar factors of change were 
identified in the two analyses. The schizo 
phrenic processes tentatively identified were 
reduced social withdrawal with motor dis 
turbances, reduced schizophrenic excitement 
reduced grandiose belligerence, and reduced 
disorganization and distortion of thinking 
These findings strongly suggest that although 
lobotomy results in the improvement of many 
patients with chronic schizophrenia, the na- 
ture of the process of improvement in schizo 
phrenia following lobotomy does not differ 
greatly from that which may occur without 
lobotomy. Two of the four factors correspond 
closely to factors identified in the preopera- 
tive study. The other two change factors ap- 
pear to have emerged out of a third preop- 
erative bipolar factor. 


Received June 2, 1954 
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Rorschach Determinant Shift Among Hallucinatory 
and Delusional Patients’ 


Robert G. Gibby, Bernard A. Stotsky, Robert L. Harrington, and 
Richard W. Thomas 


VA Hospitals, Marion, Indiana and Brockton, Massachusetts 


Several studies have shown that the changes 
which occur from free association to inquiry 
in the determinants of Rorschach responses 
can be used as additional sources of infor- 
mation concerning the subject’s. personality 
structure and its functioning (2, 3). These 
changes, which we have called “determinant 
shift,” have value as an additional experi- 
mental technique for research with the Ror- 
schach test (1, 2, 3). 

In one study (3) psychoneurotics were 
found to show significantly greater shift from 
free association to inquiry than psychotics, 
especially for shading responses. Psychoneu- 
rotics showing little shift gave significantly 
more human movement (M) and form-domi- 
nated color (FC) responses and significantly 
less pure form (F) responses on the free as- 
sociation part of the test than those showing 
marked shift. Psychotics showing little shift 
gave significantly more pure color (C) re- 
sponses; psychotics showing marked shift 
gave significantly more human movement 
(M) and color-dominated form (CF) re- 
sponses. 

The increase of shading from free associa- 
tion to inquiry was found to be related to the 
overt hostility of the examiner (1). Salk? 
found that the extent to which a person elabo- 
rated on his free association responses dur- 
ing the inquiry, i.e., the extent of determinant 
shift, was related significantly with continu- 
ance in psychotherapy. 

In view of these preliminary findings, it was 
felt that the determinant shift showed con- 
siderable promise as a research technique 


1 From VA Hospitals, Brockton, Massachusetts and 
Marion, Indiana. 
2 Personal communication from Mr. L. Salk. 


and deserved further experimental application. 
This study is another attempt to apply this 
measure. 


Design 


Two groups of patients were chosen for 
this study. The criteria for including a sub- 
ject in either group were that he be a white, 
male World War II veteran, have a total IQ 
of 80 or more on the Wechsler-Bellevue, show 
no central nervous system involvement, and 
present definite hallucinatory or delusional 
symptomatology. The Rorschach was admin- 
istered to each subject at the time that the 
hallucinations or delusions were being overtly 
manifested. In one group were 30 patients 
who reported definite hallucinations in addi- 
tion to other symptoms. In the second group 
were 30 patients for whom there was clear 
evidence of the presence of a definite delu- 
sional system. 

We cannot say that in the delusional group 
there were no hallucinations or that in the 
hallucinatory group there were no delusions. 
The absence of material indicating that a 
hallucinatory patient is delusional or that a 
delusional patient is hallucinatory does not 
necessarily mean the absence of these proc- 
esses. It is, however, possible to say that the 


characteristic symptom in one group was the 
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presence of a hallucinatory symptom and in 
the other a delusional symptom. 

The persons administering the Rorschachs 
did not know the nature of the study. All 
identifying data were removed. The records 
were scored by one person, whose reliability 
as a scorer had been established in the previ- 
ous studies. 


oes 
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Results 


The two groups were first compared for 
differences on total Rorschach responses by 
the conventional method of scoring determi- 
nants, which utilizes verbalizations on both 
free association and inquiry. All comparisons 
were made for the raw scores and also for 
the percentage scores for each determinant 
converted into arc-sine units. This has been 
described in previous studies (1, 2, 3). The 
results are summarized in Table 1. 

Since there is no difference for the total 
number of responses, it is possible to com- 
pare the groups directly on determinants. Pa- 
tients with hallucinations give significantly 
more human movement (J) responses, while 
patients with delusions show significantly 
more form-dominated color (FC) responses 
and more responses with color as a determi- 
nant (Total C, including FC, CF, and pure 
C). 

On the free association hallucinated pa- 
tients give significantly more M and V re- 
sponses. No significant differences between 
the groups are found for the other determi- 
nants. Since the frequencies for both V and 
M are too small for the differences to be 
meaningful, the two groups may be consid- 
ered not to differ significantly on free asso- 
ciation. 

When the two groups are compared on de- 


Table 1 


Comparison of Hallucinating and Deluded Patients 
for Rorschach Determinants 














Means Mean 
Sanne arc-sine 

Variable Hal. Del. CRI differences CRf 
F 14.7 13.6 2.5 
M 1.0 A 2.6** 6.0 2.9** 
FC 8 1.7 rE —6.1 y Fe 
CF 1.1 1.4 —2.5 
4 5 A 1.3 
Total C 2.3 3.5 1.6f —7.3 te ee 
FY 9 1.5 —3.2 
¥Y+YF 6 3 2.3 
V 2 J a 
Total Y 1.7 1.9 —1.5 
R 19.7 19.5 





* Significant at the .05 level. 

** Significant at the .01 level. 

t Significant at the .10 level. 

+ Only critical ratios which are significant at the .10 level 
or below are reported. 


Table 2 


Comparison of Hallucinating and Deluded Patients 
for Rorschach Determinant Shift 





Mean shift Mean 
—— — arc-sine 

Variable Hal. Del. CRI differences CRI 
F 2.2 3.3 1.6t —6.4 2.3° 
M A 6.5** 
FC 6 1.4 2.5* 4.0 1.9f 
CF A 7 9 
G 9 
Total C 1.0 2.0 3.4°* ~4.0 1.9f 
FY 7 1.0 —5.7 2.1* 
Y+YF 3 a 1.7t + 9 
V At) Jl 33” —1.1 
Total Y 1.0 1.3 —5.9 i 


* Significant at the .05 level. 

** Significant at the .01 level. 

t Significant at the .10 level. 

t Only critical ratios which are significant at the .10 level 
or below are reported. 


terminant shift, deluded patients show a sig- 
nificantly greater over-all shift in Rorschach 
determinants. (The shift on pure form is con- 
sidered the index of total shift.) Deluded pa- 
tients also shift more on FC, Total C, and V, 
while hallucinated patients shift more on M 
and YF. All differences are significant at the 
05 level. For both groups, however, the 
amount of shift on M, YF, and V is negli- 
gible. The differences for these three determi- 
nants, while statistically significant, are not 
psychologically meaningful. 

When the arc-sine scores are considered, the 
deluded patients show significantly more shift 
for F, FY, FC, Total Y, and Total C. The 
differences between groups in shift for FC 
and Total C account for the significant differ- 
ences found between the groups for these 
same determinants when they are scored by 
the conventional method utilizing the re- 
sponses on both free association and inquiry. 


Discussion 


The differences in determinant shift sug- 
gest that deluded patients are more reactive 
to the stimulus value of the examiner. In the 
free association situation the two groups show 
little difference except for M and V. When by 
means of the inquiry the subjects are brought 
into closer interaction with the examiner, the 
delusional patients respond to a greater ex- 
tent by elaborating on a greater number of 
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responses. Ite is noteworthy that the deluded 
patients sho# the most shift from pure form 
to the color jyeterminants. In the past, Ror- 
schach worlgths have taken the presence of 
color to indig‘ite capacity for affective rapport 
and for reacting to external stimulation. The 
deluded pati nts appear to show a greater 
reactivity te: external stimulation and more 
ability to modify their reactions in response 
to a change in stimulus. They may, however, 
be experiencing slightly greater anxiety in re- 
lating to the examiner (increase in shading). 
Hallucinated patients give more human move- 
ment responses on the free association. This 
could be interpreted as a tendency on their 
part to be more concerned with themselves 
than with external stimuli. Since the fre- 
quencies for M are small in both groups, this 
difference may not be particularly meaningful. 

In this study the hallucinating patients 
show more M and delusional patients more 
FC. Usually the two determinants are highly 
correlated and are considered as indicators of 
emotional stability and ability to control im- 
pulses. In this study the correlation of M and 
FC is positive but not significant (around 
.20). Thus, it is not possible from a consid- 
eration of M and FC in this study to deter- 
mine the relative stability and emotional con- 
trol of the two groups. 

In a previous study (3) it was found that 
psychotics who shifted markedly appeared to 
show better emotional control than those who 
shifted relatively little. If this finding were 
applied to the present study, it would sug- 
gest that the deluded patients show better 
control in response to the testing situation. 
Possibly the presence of hallucinations may 
point to greater impairment of functioning. 
In support of this possibility one of the au- 
thors (4) found that patients who remained 
hospitalized for more than two years tended 
to show hallucinations to a greater degree 
than patients who remitted (chi square sig- 
nificant at .10 level). 

The findings reported here are, of course, 
tentative and subject to further validational 
investigation. It has been demonstrated, how- 
ever, that determinant shift is a meaningful 
measure and that it gives information not al- 
ways available from the conventional scoring 
of the total Rorschach response. 


The major finding of the study is that the 
two groups of patients, homogeneous with re- 
spect to R, differ significantly with respect to 
determinant shift. Further, when the determi- 
nants are scored by the conventional method 
utilizing both free association and inquiry, the 
shift from free association to inquiry is re- 
sponsible for the differences found between 
the two groups on two of the significant vari- 
ables, FC and Total C. 


Summary 


1. A new method for scoring the Rorschach 
by means of the shift in determinants from 
free association to inquiry was utilized, in 
addition to the conventional method, to study 
two groups of psychiatric patients. One group 
consisted of patients whose predominant 
symptom was hallucinations; in the other the 
predominant symptom was the presence of a 
delusional system. There were 30 patients in 
each group. 

2. By the conventional Rorschach scoring 
method significant differences were found for 
M, FC, and Total C between the two groups, 
with hallucinating patients showing more M 
and less FC and Total C. 

3. When compared for determinant shift, 
the delusional patients showed more shift 
from free association to inquiry with signifi- 
cant differences for F, FY, FC, Total Y, and 
Total C. 

4. The findings were related to those of 
previous studies. It was concluded that pa- 
tients with delusions tend to react to the 
stimulus value of the examiner in the testing 
situation to a greater extent and with better 
control than hallucinated patients. 


Received June 7, 1954. 
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Changes in Wechsler Subtest Scores with Age 


Robert J. Howell 


Brigham Young University 


Since the introduction of the Wechsler- 
Bellevue Intelligence Scale for adults many 
investigations have been conducted in an ef- 
fort to determine the effectiveness of subtest 
variation as an index of mental deterioration. 
The purpose of this article is to examine 
Wechsler’s method of establishing normal or 
average deterioration with age and his as- 
sumptions regarding the variability of this 
deterioration. 

Wechsler (6) constructed his tables of nor- 
mal deterioration by summing the means of 
the “hold” tests and the means of the “don’t 
hold” tests for each five-year age group (be- 
ginning at the age of 20) and dividing the 
difference of the two by the sum of the means 
of the hold tests (6, pp. 65, 222, Tables 39 
and 40). This method may be thought of as 
being a ratio of means. Undoubtedly, the ease 
of using data that had already been computed 
dictated its use. A more conventional manner 
of determining average deterioration would be 
to compute deterioration scores for each in- 
dividual within an age group and then deter- 
mine the mean of these scores. Such a method 
may be referred to as a mean of ratios score, 
that is, a mean derived from individual de- 
terioration scores. This latter method permits 
the computation of variability of deteriora- 
tion directly, whereas in the former method 
variability may be estimated only by refer- 
ence to the variability of individual subtests. 
Since there is no mathematical relationship 
between the two methods, any similarity of 
the resulting means must be determined em- 
Pirically. 

A second question may be raised as to the 
adoption of a 10% and a 20% deterioration 
score above that allowed for by normal de- 
cline with age as being indicative of possible 
and definite pathological organic deterioration 
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respectively. Reportedly these figures, 10% 
and 20%, correspond “roughly to deviations 
of minus one PE and minus two PE from the 
mean at age 20-25” (6, p. 66). How these 
figures were obtained is difficult to ascertain, 
since the deterioration score resulting from 
summing each don’t hold test score one PE 
below its mean is 18% at this age interval. 


Method 


In an attempt to investigate these two prob- 
lems six subtests of the Wechsler-Bellevue In- 
telligence Scale, Form I, were administered to 
397 American-born white subjects ranging in 
age from 20 to 89 years. All of the subjects 
were considered within the normal range so 
far as behavioral adjustment was concerned. 
The 20-29 age group was drawn at random 
from the files of the University of Utah Coun- 
seling Center. Being college students, they 
would be expected to score somewhat above 
average on the subtests. The rest of the sam- 
ple was taken primarily from the urban and 
suburban areas of Salt Lake City. Thirty- 
eight of the subjects in the 60-89 age group 
resided in private and charitable homes for 
the aged, while the remaining 62 lived in the 
community. All of this group were free from 
any apparent handicaps that might have af- 
fected their performance on the test battery. 

The six subtests were Information, Com- 
prehension, and Vocabulary (comprising the 
hold tests), and Picture Arrangement, Block 
Design, and Digit Symbol (comprising the 
don’t hold tests). It should be noted that 
these are not the same tests as suggested by 
Wechsler for measuring mental deterioration. 
Originally it was felt desirable to maximize 
deterioration in studying the nature of the 
two curves. Inspection of Wechsler’s original 
standardization data (6, p. 222, Tables 39 and 
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40) shows that the first two tests (Vocabulary 
is not reported) are the most resistant to in- 
creasing age and the last three the least re- 
sistant. Other investigators (1, 2, 3, 4, 5) 
have found the same results. The use of these 
tests will in each instance yield a higher de- 
terioration score, but since the variability of 
all the tests is approximately equal at each 
age level, it should be possible to draw con- 
clusions as to the variability of deterioration 
as determined by this test battery which 
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would apply to the tests that Wechsler em- 
ployed in estimating normal deterioration. 


Results and Discussion 


Table 1 indicates the means and standard 
deviations of each of the subtests at each age 
interval. It should be noted that the first 
three tests show little decline with advancing 
age, while the last three decline progressively, 
finally to about half the magnitude of the 
hold tests. Undoubtedly the older persons’ in- 


Table 1 


Means and Standard Deviations of Subtests 








Age N Info. Comp. 
20-24 135 12.30 13.47 
2.00 1.92 
25-29 65 13.08 14.43 
1.88 1.91 
30-34 26 12.85 13.69 
3.21 2.73 
35-39 12 11.33 11.08 
3.40 4.13 
40-44 10 11.40 13.00 
3.67 3.61 
45-49 10 12.00 14.20 
2.32 2.93 
50-54 18 11.00 12.17 
2.16 2.14 
55-59 21 10.95 11.67 
3.33 3.10 
60-64 20 11.35 11.40 
2.52 2.78 
65-69 23 11.26 11.83 
2.75 2.16 
70-74 21 10.90 11.28 
2.89 1.98 
75-79 16 10.62 10.94 
3.16 2.08 
80-84 16 9.38 9.31 
3.08 2.02 
85-89 4 9.25 12.25 











Pict. Block Digit 
Vocab. Arr. Design Symbol 
11.88 12.28 13.18 12.61 
2.06 2.06 2.73 2.24 
12.58 12.29 13.72 12.51 
1.84 2.94 2.24 2.35 
12.77 10.81 12.42 10.92 
3.29 3.25 3.12 3.06 
11.08 9.08 9.75 9.75 
3.30 3.50 3.84 4.04 
11.40 8.80 9.70 9.10 
4.03 3.19 3.62 3.30 
12.80 9.90 10.50 9.10 
2.68 3.14 3.14 3.01 
11.50 8.33 9.83 8.17 
2.01 2.52 2.48 
11.28 7.76 8.67 6.90 
2.57 2.65 2.93 2.56 
11.80 7.50 7.80 7.05 
2.23 3.01 2.27 2.69 
11.52 6.96 8.13 5.87 
2.45 2.31 2.83 1.83 
11.38 5.52 6.05 5.43 
2.17 1.62 1.84 2.42 
11.38 5.69 6.19 4.50 
2.47 2.44 2.77 2.42 
10.81 4.06 5.25 3.31 
2.98 1.34 2.05 1.40 
9.00 5.00 4.50 4.00 


1.73 
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Fig. 1. Percentage deterioration scores by ages: mean of ratios, ratio of means, and variability of deteriora- 
tion scores. 


ability to react rapidly was a contributing 
factor to the decline, particularly in the case 
of Digit Symbol; however, time seemed to 
have little effect on their ability to solve Pic- 
ture Arrangement and Block Design. Once an 
individual missed one of the stories or de- 
signs, it was unusual for him to correctly com- 
plete a subsequent one, regardless of the time 
involved. 

Figure 1 indicates the deterioration curves 
as computed by each method as well as the 
variability. It should be noted that the two 
curves virtually overlap each other at all ages. 
A plausible explanation of the similarity of 
the two curves would seem to be in the op- 
eration of compensating factors. It should 
also be noted that the deterioration curves 
are essentially linear throughout the entire 
age range. This corroborates Wechsler’s find- 
ings up to the age of 55 and adds strength to 
his assumptions of linearity in the older age 
groups. 





It can be seen from Table 2 that the PE 
variability at age 20-24 is 10%, as Wechsler 
had assumed. Furthermore, inspection of Fig- 
ure 1 reveals the variability to be approxi- 
mately constant throughout. In order to test 
Wechsler’s assumption that the PE at each 
age interval was 10% (or 14.8% in standard 
deviation units) ¢ ratios were computed be- 
tween this theoretical variability and the em- 
pirically derived variability (Table 2). In 
only one instance, age 80-84, was the ¢ ratio 
significant at the .01 level. 

A limiting factor in this study was the 
relatively small number of subjects at each 
age interval, but it may be tentatively con- 
cluded that Wechsler’s assumption of equal 
variability of deterioration at all age levels 
is correct. It should be noted, however, that 
no attempt was made to determine the va- 
lidity of his claim that 10% and 20% de- 
terioration above normal is indicative of 
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Table 2 


Variability of Deterioration Scores at Various Ages 























Variability Variability 
Age N (PE) (SD) t ratios* p* 
20-24 135 105 156 84 >.1 
25-29 65 .090 134 1.17 >.1 
30-34 26 101 150 10 >1 
35-39 12 159 235 1.81 e- 
40. 44 10 .067 100 2.18 >.05 
45-49 10 .096 143 .16 >.1 
50-54 18 090 133 68 >.1 
55-59 21 101 149 04 >.1 
60-64 20 082 121 1.42 >.1 
65-69 23 O89 132 84 >.1 
70-74 21 075 111 2.18 <.05 
75-79 16 091 135 54 >.1 
80-84 16 057 O85 4.20 <.001 
85-89 4 089 132 34 > 2 
* Significance of the difference between the observed variability and a variability of .10 (10%). 


pathological organic damage. This is a clini- 
cal problem and not a statistical one. 

The assumption of equal variability of de- 
terioration throughout the life span may ap- 
pear, at first glance, contradictory to the 
widespread idea that with increasing age 
there is an increase in variability in both 
mental and physical dimensions. Such have 
been the findings of several investigators with 
respect to intelligence. It may be, however, 
that the deterioration index is relatively in- 
dependent of the intellectual level. Likewise 
the variability of this measure of deteriora- 
tion may be independent of other seemingly 
related factors. 


Summary and Conclusions 


Three hundred and ninety-seven subjects, 
ranging in age from 20 to 89 years, were ad- 
ministered six subtests of the Wechsler-Belle- 
vue Intelligence Scale, Form I, in an effort to 
ascertain the similarity of Wechsler’s method 
of computing normal deterioration (a ratio of 
means) with the more conventional method 
of determining a mean of individual deteriora- 
tion scores. In computing deterioration by this 
latter method it was also possible to deter- 
mine the variability of deterioration in order 
to test Whechsler’s assumption that the PE of 
deterioration is 10%, and that this is con- 


stant throughout the age span. It was con- 


cluded that: 

1. Even though there is no mathematical 
relationship between the two methods of 
computing deterioration, the resulting curves 
were virtually identical. 

2. Deterioration is linear above the age of 
55 as well as in the lower age levels, as found 
by Wechsler. 

3. There is approximately equal variability 
of deterioration at all age levels. 


Received May 13, 1954. 
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Davis-Eells (“Culture-Fair”) Test Performance 
of Lower-Class Retarded Children’ 


Sidney Rosenblum, James E. Keller 


Wayne County Training School 


and Ned Papania 
VA Mental Hygiene Clinic, Detroit 


It is the contention of Davis and his asso- 
ciates at the University of Chicago (2) that 
some of the more widely used group and in- 
dividual tests of intelligence tend to “dis- 
criminate” against the lower social class child 
as a function of the highly verbal, “academic” 
nature of the items they contain. To remedy 
this situation, the Davis-Eells Test of Gen- 
eral Intelligence or Problem-Solving Ability, 
a “culture-fair” intelligence test free of read- 
ing requirements, has been developed, which, 
according to its authors, provides a more 
“valid” estimate of a child’s level of intel- 
lectual functioning because it draws its prob- 
lems entirely from experiences common to all 
or nearly all children who are tested. 

The present investigation was designed to 
evaluate the performance on the Games (as 
the test is commonly known) of a group 
of high-grade mentally handicapped (nonor- 
ganic) school-aged boys of lower social class 
standing, and to compare these findings with 
those obtained from three other tests: a group 
test of intelligence requiring reading ability 
(California Test of Mental Maturity), and 
two individually administered tests of intelli- 
gence known to contain verbally loaded, aca- 
demic-type items (Revised Stanford Binet 
Test of Intelligence, Form L, and the Wechs- 
ler Intelligence Scale for Children).? If it is 


1 From the Wayne County Training School, North- 
ville, Michigan, Robert H. Haskell, M.D., Medical 
Superintendent; Thorleif G. Hegge, Ph.D., Director 
of Research and Education. 

2 Throughout the rest of this study the following 
abbreviations will be used: WISC-FS, V, P (Wechs- 
ler Intelligence Scale for Children—Full Scale, Verbal 





reasonable to assume that many lower social 
class children diagnosed “mentally deficient” 
carry such a label mainly because of de- 
pressed functioning on intelligence tests sup- 
posedly partial to their middle- and upper- 
class peers, then a group like ours should 
perform significantly better on a culture-fair 
test than on the three other instruments un- 
der investigation. 


Method 


Subjects. Thirty boys with a mean chrono- 
logical age of 12—1 (range 10-2 to 13-8), 
and a mean initial IQ of 67.57 (range 55 to 
75), constituted the experimental population 
on whom data were collected. Of the group, 
15 were Negroes, 15 were white. Mean length 
of residence in the Wayne County Training 
School was 2.6 years (range: .5 to 6.7 years). 

Procedure. A rating of “low-status” for 
each subject was determined by Eells’ modifi- 
cation of Warner’s Index of Status Charac- 
teristics.* If the Binet, used initially to select 
the group, had been administered more than 
six months before, it was readministered. 
Both the Binet and WISC were administered 
in counterbalanced order prior to group test- 
ing with the Games, which were given ap- 
proximately three weeks later according to 
standardized procedure. Five weeks later, the 


Scale, Performance Scale); CMM (California Test 
of Mental Maturity). 

8In terms of Warner’s original categories these 
subjects would approximate the lower-lower class 
socioeconomic group. For a detailed description of 
this modified class typing see Eells and Davis (Z, 
ch. 11). 
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Games were readministered individually. Dur- 
ing this second session an “inquiry” was held 
on approximately half the test’s items (se- 
lected in a random manner) to discover if the 
subjects were choosing right answers for the 
right reasons.‘ The group California Test of 
Mental Maturity was administered two weeks 
later. 


Results and Discussion 


Table 1 summarizes the comparisons of the 
mean scores obtained by our population on 
the Davis-Eells Games and the three other 
instruments used in this experiment. It is im- 
mediately apparent that the mean score on 
the Games is not significantly higher for our 
population than those on the other measures 
under consideration. In one instance, a sig- 
nificantly higher mean score favoring the 
WISC-P over the Games was obtained. One 
possible explanation of the WISC-P superior- 
ity lies in the actual “kinesthetic” manipu- 
lation of things required by most of the 
WISC-P items. This allows for an appraisal 
by the subject of his performance, and per- 
mits correction of errors as they are recog- 
nized. No such self-corrective opportunities 
are present in answering Games items. The 
child can respond after one quick glance at 
the picture and he has no way of “checking” 
whether his response is right or wrong. It was 
noted that many of our subjects, although 
told repeatedly to listen to all the instructions 
before selecting an answer, were unable to 
wait until the instructions had been com- 
pletely read before marking their response. 
This widespread emphasis on speed and in- 
ability to inhibit response tendencies may 
have contributed significantly to lowered 
Games performance. 

Several explanations can be offered to ac- 
count for the failure of the Games to reveal 
the “hidden” potential in our population sup- 
posedly not tapped by other tests of intelli- 
gence. First, though the test may not contain 
culturally biased items, as Davis and Eells 


*No analyses of the data obtained from the in- 
dividually administered Games are presented since 
the writers’ sole purpose was to investigate the “va- 
lidity” of the subjects’ responses through an in- 
quiry, which could be done only through individual 
sessions with each child. 








Table 1 


Comparisons of Davis-Eells Games with Binet, 
WISC, and CMM 














Test Mean SD t 
Games 64.65 8.02 
Binet 65.87 5.03 88 
WISC 
FS 66.53 6.46 1.57 
V 66.63 5.09 1.38 
P 72.67 10.09 4.31* 
CMM 66.47 7.07 1.24 





* Significant at .01 level. 


contend, the conditions under which the test 
was administered to our group cannot be said 
to have been completely free of middle-class 
cultural overtones. The Games were given to 
our subjects in a school building on a school 
day by middle-class individuals undoubtedly 
identified with the school system. Although 
the group was solving problems via pictures 
rather than responding to a series of aca- 
demic-type items, the materials used in this 
process were pencil and paper, the basic 
physical ingredients involved in most school 
work. Although presented to them as a series 
of games, which Davis and Eells claim will 
encourage a child to exert maximum effort, 
our subjects were not fooled and revealed by 
their comments that they knew from the out- 
set that they were taking another test. Since 
it is known that an academic atmosphere 
often elicits more feelings of hostility and 
lowered interest on the part of many lower- 
class children as compared to their more 
scholastically oriented middle-class peers, it 
might be reasonable to assume that similar 
feelings were aroused in our subjects during 
administration of the Games, and that these 
feelings had a negative effect on their per- 
formance. In other words, what is being sug- 
gested is that the method of group adminis- 
tration of the Games did not elicit the highly 
motivated behavior on the part of our sub- 
jects that might be expected from a sample 
of their middle-class peers. 

An alternative explanation for our findings 
is that our subjects are genuinely deficient in 
problem-solving ability, and that this deficit 
would manifest itself not only in a middle- 
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class culture but in their own lower-class cul- 
tural milieu as well. Analyses of the data ob- 
tained from individual inquiries lend support 
to such a hypothesis. Our subjects made 
errors on the Games not because they were 
unfamiliar with the content of the items but 
because of a failure to make correct associa- 
tions, discriminate crucial differences, and 
organize elements of a problem into a mean- 
ingful pattern. 


Table 2 


Percentage of Subjects Giving Correct Reasons for 
Correct Responses on the Davis-Eells Games 














Item Percentage 
Probabilities 10 
Money 0 
Best Ways 47 
Analogies 3 
All items 0 





Table 2 gives a tabulation of the percent- 
age of subjects giving correct reasons for 
their correct Games responses. It can be seen 
that not one of our 30 subjects was able, 
upon questioning, to verbalize the reasoning 
he should have used for all cases for which 
he chose the correct answer. Davis and Eells 
cite a study (4) in which it is indicated that 
92% of a group of normal school children 
who marked right answers for the “analogy” 
problems explained the analogous relation- 
ship correctly in an interview. The figures of 
Table 2 indicate that only 3% of our popula- 
tion were able to do this, and that not a 
single subject used the correct approach in 
solving the “money” problems. Both these 
tests demand an abstract approach and re- 
quire the subject to use a series of interven- 
ing symbolic mental steps in solving the prob- 
lem. “Best ways” and “probabilities,” which 
seem to require a less abstract set, were han- 
dled somewhat better, but even with these 
tests the percentage of subjects giving correct 
reasons for correct answers is not very high. 

In general, then, these data tend to sup- 
port the now widely accepted view that one 
very important condition in cases of mental 
deficiency is the lack of ability to abstract. 
It may be, as McCandless (3) and others 
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have indicated, that membership in the lower 
social classes tends to produce this concret- 
istic mode of thinking, and that our group 
represents an extreme example of this phe- 
nomenon. Whatever the explanation, our 
study suggests that performance on the Davis- 
Eells Games is as much affected by this loss 
in abstract thinking ability as are other tests 
of intellectual functioning. 

In closing, it should be pointed out that 
the experimenters have been concerned only 
with the ability of the Davis-Eells Games to 
tap an intellectual potential not revealed by 
other standardized tests of intelligence. The 
present investigation strongly suggests that 
they do not do so with our population. How- 
ever, the test may prove useful in another 
way—by predicting the ability of children to 
handle the practical problems peculiar to 
daily Training School living that are not re- 
vealed or suggested by school achievement or 
routine test performance. The authors of the 
Games state their test requires the subject to 
use mental activities also required in “solv- 
ing most problems in life and in the school 
curriculum” (1), but to date no work has 
been published to demonstrate the validity of 
their assumption either with an institutional- 
ized or noninstitutionalized population. It is 
one thing to prepare an operationally sound 
test to define a concept such as problem-solv- 
ing ability; it is entirely another matter 
whether the test is useful in the sense that it 
predicts the behavior it purports to measure. 
As yet, we do not know the types of behavior 
the Games predict for our specific population. 
Further research will be needed to answer 
this question and to investigate the poten- 
tialities of this test for use with the high- 
grade mentally handicapped child. 


Summary 


To determine if the Davis-Eells (culture- 
fair) Games would tap an intellectual poten- 
tial not revealed by other tests of intelligence 
and reveal a “truer” picture of the level of 
functioning of a group of lower-lower social 
class, high-grade mentally handicapped (non- 
organic) children, the Games were adminis- 
tered to 30 school-aged boys in residence at 
the Wayne County Training School. Results 
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were compared with those of three other 
standardized intelligence tests: the Binet, 
WISC, and California Test of Mental Ma- 
turity. 

In general, it was concluded that for this 
population the Davis-Eells Games do not 
tend to reveal a “hidden intellectual poten- 
tial”—by virtue of their elimination of cul- 
turally unfair items—not tapped by other in- 
telligence tests presumed to be culturally 
biased. Several explanations are offered for 
this finding, and suggestions for future re- 
search with the Games are indicated. 


Received June 10, 1954. 
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A Sexual Deviation Scale for the MMPI 


James T. Marsh, Jessamine Hilliard, and Robert Liechti 
School of Medicine, University of California at Los Angeles 


This report represents the preliminary find- 
ings in the development of a sexual deviation 
scale for the MMPI. The work was done as 
one phase of a research into biochemical and 
personality factors in sexual deviation.’ 

This tentative MMPI scale was constructed 
in answer to the question whether or not in- 
dividuals convicted of sex offenses can be dis- 
tinguished on the basis of an objective per- 
sonality test from presumably normal indi- 
viduals having no records of arrests for sexual 
offenses. 

A scale capable of this discrimination could 
be a useful adjunct to established clinical 
procedures in the diagnosis and treatment of 
sexual psychopathy. In addition, such a scale 
could find application as a screening device in 
the selection of individuals for work involving 
close contact with children. 

The MMPI was chosen as the instrument 
for study since it is objective, easily adminis- 
tered and scored, and includes a wide range 
of items tapping attitudes, affects, personality 
traits, and symptoms. The variety of items 
included in the MMPI in particular repre- 
sents an advantage for a scale of this type, 
since it makes possible discrimination on the 
basis of items not directly related to sexual 
attitudes or experiences, and thus may be less 
accessible to modification by the defensive 
subject who seeks to present himself in the 
most favorable light. 


Subjects 


Sex offenders. The sex offender population 
was composed of men convicted of some sex 
offense and committed to the Metropolitan 


1 Conducted jointly by the Medical School of the 
University of California at Los Angeles and the 
Metropolitan State Hospital, supported by grants 
from the legislature of the State of California. 
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State Hospital for observation, diagnosis, and 
treatment under the provisions of the Cali- 
fornia Sexual Psychopath Act. They ranged 
in age from 17 to 70 years, with a mean age 
of 36 years. Eighty-five per cent were na- 
tive-born white men, and approximately 11 
per cent were of Spanish-American origin. 
Intelligence levels, as measured by the Ship- 
ley-Hartford or Beta tests, were approxi- 
mately normal in distribution although slightly 
skewed toward the higher intelligence ranges. 
Almost 60 per cent of the group had records 
of one or more previous convictions, two- 
thirds of which were for sexual offenses. Acts 
leading to hospitalization under the Sexual 
Psychopath Act include indecent exposure, 
child molestation, rape, and homosexual con- 
tacts with minors, the majority of these of- 
fenses involving sexual activity with children. 

All sex offenders committed to the hospital 
for observation and diagnosis are given a bat- 
tery of psychological tests which includes the 
group form of the MMPI. The tests are ad- 
ministered within the first few weeks after 
admission. The MMPI records utilized in 
the present study were obtained from the 
hospital files. 

Comparison subjects. These subjects were 
drawn from a population of male students in 
education at U.C.L.A. They ranged in age 
from 18 to 47 years, with a mean of 30 years. 
The group was composed both of full-time 
undergraduate university students and indi- 
viduals active in the field of education who 
were doing graduate work toward advanced 
degrees. The latter included superintendents, 
principals, and teachers from the Southern 
California area. The mean intelligence and 
education levels for this group exceeded that 
of the normal population. These students 
are routinely given a battery of psychological 
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tests including the MMPI during the course 
of training. Records used in this study were 
drawn from the files of the education depart- 
ment at U.C.L.A. 


Procedure 


Construction of the scale was begun by 
drawing 100 MMPI records in the form of 
machine-scoring answer sheets from the hos- 
pitalized offender population and 100 records 
from the normal population. These were sub- 
jected to item analysis. A complete count 
was made of the true and false responses on 
each of the 566 MMPI items for both nor- 
mal and sex offender groups. The number of 
true and false responses for each group on 
each item was then tabulated and this tabu- 
lation carefully inspected item by item for 
differences between the two groups. In each 
instance where considerable difference in the 
proportions of true and false answers ap- 
peared, a chi-square test was applied to de- 
termine the probability that such differences 
may have occurred by chance. In those in- 
stances where the number in any cell of the 
fourfold chi-square table fell below five, 
Yates’ correction for continuity was applied. 
As a result of statistical analysis, 100 items 
were selected, each of which differentiated 
the normal and sex offender groups at a sta- 
tistically significant level of .01 or beyond. 
In order to conserve space, only the numbers 
of these items, taken from the MMPI group 
form booklet, are reproduced here.” 


Sex offenders, in contrast to the comparison group, 
tend to answer as true items 5, 59, 61, 67, 76, 84, 88, 
94, 98, 106, 111, 118, 127, 138, 139, 140, 144, 147, 
158, 168, 170, 179, 239, 249, 260, 297, 298, 303, 304, 
316, 329, 346, 348, 349, 350, 352, 360, 364, 365, 373, 
375, 377, 378, 382, 385, 389, 395, 404, 413, 419, 427, 
444, 453, 455, 457, 458, 483, 488, 489, 490, 492, 498, 
507, 548, 549, 558, 559, and 562. 

Sex offenders, in contrast to the comparison group, 
tend to answer as false items 6, 12, 20, 37, 39, 46, 
51, 63, 89, 120, 133, 134, 155, 160, 163, 255, 289, 294, 
302, 328, 347, 367, 372, 376, 379, 380, 430, 432, 449, 
460, 547, 554. 


2 An 8-page table giving the number, text, deviant 
answer, x’, and p level of each item has been de- 
posited with the American Documentation Institute. 
Order document number 4420 from the ADI Aux- 
iliary Publications Project, Photoduplication Service, 
Library of Congress, Washington 25, D. C., remit- 
ting in advance $1.25 for microfilm or $1.25 for 
photocopies. Make checks payable to Chief, Photo- 
duplication Service, Library of Congress. 





To test the possibility that these 100 items 
might be of discriminative value, an MMPI 
scoring key was constructed from the re- 
sponses of the sexual offender group. Scores 
for these items were then obtained for 200 
additional sex offender records and 145 new 
student records. Each response in a deviant 
direction (i.e., answered in the same direction 
as the original sex offender group answered 
it) was scored as one unit with the possible 
range of scores extending from 0 to 100. The 
actual range of items answered in a deviant 
direction for this total sample of 345 records 
fell between 10 and 70. 


Results 


The distribution of scores for the sex of- 
fender and comparison groups obtained on 
the new scale is presented in Table 1. The 
mean number of items answered in the deviant 
direction by the hospitalized sex offenders is 
42.1 with a standard deviation of 9.3, while 
that of the comparison student group is 21.3 
with a sigma of 6.5. The best cutoff point 
to distinguish these groups seems to lie be- 
tween 30 and 31 items. 

For cross-validation purposes, two new 
samples were drawn from the sex offender and 
comparison populations and scored on the 
sexual deviation key. These samples con- 


Table 1 


Distribution of 145 Normals and 200 Sex Deviates 
on a 100-Item Sexual Deviation Scale 




















Frequency 
MMPI scale Normals Sex offenders 
score (N=145) (N = 200) 
66-70 2 
61-65 3 
56-60 14 
51-55 26 
46-50 31 
41-45 2 30 
36—40 4 36 
31-35 12 38 
26-30 22 9 
21-25 38 9 
16-20 39 2 
11-15 25 
6-10 3 
0-5 
Mean 21.3 42.1 
SD 6.5 9.3 
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Fig. 1. Distribution of scores on MMPI sexual deviation scale for 338 hospitalized sex offenders and 
317 students. The abscissa represents the number of items from the 100-item scale answered in a devi- 


ant direction. 


tained 138 sex offender records and 172 stu- 
dent records. Distribution of cases and means 
in these new groups so closely approximated 
that of the original samples that it was pos- 
sible to combine validation and cross-valida- 
tion data. 

Figure 1 illustrates the graphic distribution 
of all combined samples, 317 normals and 338 
offenders. The mean number of items answered 
in a deviant direction by members of the 
comparison group is 21.8 with a standard 
deviation of 6.8, while the sex offender mean 
is 41.7 with a standard deviation of 9.1. 

Table 2 presents the distribution of the 
combined validation and cross-validation sam- 
ples on the new scale. Scores of 283 normals 
and 41 sex offenders fall below a cutoff point 
placed between 30 and 31 items, whereas 
scores of 34 normals and 297 sex offenders fall 
above. This scale appears to differentiate 
these groups with a high degree of efficiency 
since it correctly identifies 88 per cent of of- 
fenders and misclassifies only about 11 per 
cent of the comparison subjects. 


Table 2 


50 60 70 


Distribution of 317 Normals and 338 Sex Offenders 


on the Sexual Deviation Scale 














Frequency 
MMPT scale Normals Sex offenders 
score (N=317) (N = 338 
71-75 1 
66-70 2 
61-65 9 
56-60 20 
51-55 33 
46-50 54 
41-45 4 64 
36-40 11 58 
31-35 19 56 
26-30 46 23 
21-25 89 14 
16-20 93 3 
11-15 50 1 
6-10 4 
1-5 1 

Mean 21.8 41.8 
SD 6.8 9.1 











Discussion 


With a view to gaining a clearer under- 
standing of factors contributing to high and 
low scale scores, cases falling at the extremes 
of the two distributions and in the area of 
overlap were carefully inspected. Screening 
interview notes and psychological test data 
were available for the education student com- 
parison subjects with high and low scale 
scores, and upon inspection of these it was 
evident that personality difficulties had been 
noted in almost every case where sexual devia- 
tion scale scores exceeded 35 items. The fol- 
lowing notes are typical of many cases in 
this range: 


Scale score 39. “Referred for psychiatric counsel- 
ing with history of extreme irresponsibility. Lives 
in parasitic relationship with mother figure. In in- 
terview stated inability to form normal relations 
with either sex. Abandoned by mother very early. 
Stated he wished to talk to a male rather than a 
female doctor. MMPI: K 78, D 84, Pd 86, Mf 98, 
Pt 95, Sc 96, Ma 86. A very serious teaching risk 
who will probably be barred.” 

Scale score 34. “Referred for psychiatric counsel- 
ing. Psychosomatic skin disorder. Wishes further 
therapy and now in treatment. MMPI scores above 
70: D 75, Mf 78, Pt 76, Sc 78.” 

Scale score 36. “Referred for psychiatric counsel- 
ing. Math major, chess enthusiast. Lives with aunt 
and mother. Bright but socially inept. Difficult 
family situation resulted in depression and ‘nervous 
breakdown.’ Approved for teaching after further 
testing. No MMPI scores above 70.” 

Scale score 44. “Referred for psychiatric counsel- 
ing. Married, good skills. Very religious, recently 
converted. Helped much by wife after ‘nervous 
breakdown’ following two navy enlistments. MMPI 
scores above 70: Mf 85, Hs 75.” 


The case history material from the student 
group suggests that scores of 35 and over may 
be indicative of personal maladjustment. With 
the information available, it was not possible 
to ascertain either the presence or absence of 
deviant sexual behavior and the relation of 
this factor to high scores in the student group 
is unknown. Inspection of case records of stu- 
dents scoring in the low ranges (10 to 20) 
revealed a considerably lower incidence of 
personality maladjustment. 

Sex offenders with high and low scale scores. 
Psychiatric histories and probation reports on 
the sexual offenders whose scores fell at the 
extremes of the scale were also inspected. 
Child-molesting offenses were found to occur 
more frequently in the group with highest 
scale scores. A higher incidence of cases diag- 
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nosed as cerebral arteriosclerosis was also 
found in this group. In addition, these indi- 
viduals had completed on the average fewer 
years of schooling, and tended to be older 


than those with the lowest scores. When 
MMPI scale scores were compared for these 
extremes, it was found that those with high 
sexual deviation scores also had significantly 
higher scores on the F, D, Pa, Pt, and Sc 
scales. A significant difference was also found 
for the K scale, high deviation scores being 
associated with low K values. 

Scale scores of neurotic and psychotic pa- 
tients. As a further check on the discrimina- 
tive value of the scale, MMPI records of 50 
neurotic and 50 psychotic patients at Metro- 
politan State Hospital were scored with the 
sexual deviation key. Scores ranged from 21 
to 60 items answered in a deviant direction. 
In general, psychotic patients received higher 
deviation scores than neurotics, their mean 
falling at 39, whereas the mean for the neu- 
rotics was 36. The distribution of scores sug- 
gests that the scale does not discriminate sex 
offenders from hospitalized mental patients. 
The overlap in the distribution of scale scores 
for these two groups lends support to the 
hypothesis that some factor of personality in- 
tegration or adjustment is being measured by 
the scale. Scores from both groups appear to 
be distributed in accordance with such a fac- 
tor since the lowest scores in the psychotic 
group were obtained from patients diagnosed 
as paranoid schizophrenics whereas the high- 
est scores were from catatonics and hebe- 
phrenics. This is compatible with the clinical 
finding that paranoid schizophrenics as a group 
retain a better reality contact than other 
schizophrenics. 

MMPI items composing the sexual devia- 
tion scale. The majority of the items which 
differentiate hospitalized sex offenders from 
comparison subjects can be grouped into cate- 
gories in accordance with attitude or feeling 
content. The pattern of these items, although 
not descriptive of any single individual, yields 
a rough, self-descriptive picture of the hos- 
pitalized sex offender which agrees quite 
closely with clinical observations reported in 
the literature. 


Sex offenders are often characterized as fearful, 
passive-dependent, inadequate individuals who are 
sensitive, shy, and inept in social relations. MMPI 
items 39, 111, 138, 140, 147, 304, 389, 395, and 459 
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are generally answered by sex offenders in the direc- 
tion which illustrates this point. Poor social rela- 
tions are particularly evident by their answers to 
items 59, 348, 377, 404, 449, 455, and 547. A tend- 
ency to be suspicious and to project unacceptable 
thoughts and feelings on others is shown by their 
answers to items 127, 347. 364, 376, and 507. That 
personality difficulties may date back to relatii-- 
ships and experiences in childhood is suggested by 
items 118, 419, 453, 458, and 562. As a group, hos- 
pitalized sex offenders are subject to many fears 
which are often unrealistic, as illustrated by items 
5, 352, 360, 367, 385, 492, and 559. They suffer 
from a variety of mental and physical complaints as 
indicated in items 51, 63, 139, 155, 160, 163, 168, 346, 
349, 350, and 365. Guilt and depression, probably re- 
lated to deviant sexual behavior, are prominent feel- 
ings, as is evident in items 49, 61, 67, 76, 84, 106, 
158, 375, 379, 382, 413, and 489. The guilt and de- 
pressive reactions may stem in part from violation 
of taboos laid down by strong fundamentalist re- 
ligious convictions reflected in items 98, 249, 373, 
483, 488, and 490. The focus of conflict in the sexual 
area is evident in items 20, 37, 133, 179, 297, 427, 
548, and 558. Some asocial and amoral attitudes are 
apparent in items 144, 289, 294, 298, and 316. 


The variety of categories into which items 
can be grouped points to a broad base for the 
discriminative power of the scale. 

Limitations of the scale. Despite the prom- 
ising preliminary results obtained with the 
scale, its usefulness for diagnostic purposes 
is restricted at present by the selective nature 
of the validation groups. The hospitalized sex 
offender group cannot be considered as repre- 
sentative of the total population of sex of- 
fenders since several factors operate to screen 
this group. One screening factor is the ratio 
of offenses to arrests. It has been estimated 
that only a fraction of sex offenses results in 
arrests. Further, the majority of individuals 
arrested and convicted of sex offenses are not 
committed to hospitals for care and treat- 
ment under the California Sexual Psychopath 
Act. Few individuals are committed on the 
basis of first offenses unless these involve ag- 
gressive behavior or minor victims. In view of 
these selective factors the sex offender group 
used in this study may not be representative 
of the total population of individuals who 
behave sexually in ways which violate the 
law. It does, however, represent a group of 
individuals who, in the best judgment of psy- 
chiatrists and the courts, must be considered 
dangerous to the health and safety of others 
because of aberrant sexual behavior. 

The comparison group drawn from a stu- 
dent population is also subject to selective 
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factors. Certainly, this group is atypical of 
the general population in terms of educational 
level and possibly atypical in terms of socio- 
economic background. The fact of college at- 
tendance presumes also a degree of sophistica- 
tion in terms of tests which the majority of 
sex offenders have not had the opportunity 
to acquire. 

In view of these limitations, diagnostic ap- 
plication of the scale should await further 
validation with new groups. In particular com- 
parison groups with socioeconomic, educa- 
tional, and experiential backgrounds similar to 
the sex offender group are needed. The scale 
is presented at this time in the hope that 
other interested investigators may extend its 
range of application through further valida- 
tion. 

Summary 


In the effort to develop an MMPI scale to 
distinguish sex offenders from normals, re- 
sponses of 100 hospitalized sex offenders and 
100 normal education students to 566 MMPI 
items were subjected to item analysis. One 
hundred items were found which differentiated 
the two groups at a statistically significant 
level in terms of direction (true or false) of 
response. 

These items were combined into a scale for 
which scoring keys were constructed. The 
scale was applied to new samples of 338 hos- 
pitalized sex offenders and 317 education stu- 
dents. Utilizing a cutoff point of 30 out of a 
possible 100 items answered in a deviant di- 
rection, the scale was found to discriminate 
between groups with but 12 per cent false 
negatives among sex offenders and 11 per 
cent false positives among normals. 

Cases with scores at the extremes of the 
distributions of both groups were examined 
for possible factors contributing to the scores. 
The items discriminating offenders from stu- 
dents were combined into clusters which de- 
scribe some personality features of sex of- 
fenders. 


Received May 10, 1954. 
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The Relationship of the Wechsler-Bellevue Verbal 
Scale and the Progressive Matrices Test’ 


Mahesh M. Desai 


Belmont Hospital, Sutton, Surrey, England 


In view of the fact that the Progressive 
Matrices (PM) and the Wechsler-Bellevue 
(WB) are both regarded as good measures of 
intelligence, the two tests are compared in 
this study. A group of 190 consecutive male 
admissions to the hospital were given the PM 
as a group test during the second week after 
admission, and within the following 3 days 
they were given 3 or more tests of the WB 
Verbal Scale (Form I). Of these 120 had all 
6 tests. The mean age was 31.7 (SD, 8.8) 
and the socioeconomic status almost wholly 
lower-middle or working class. Psychiatrically, 
121 were neurotics, 30 psychopaths, 13 or- 
ganics, 9 early schizophrenics, and 17 miscel- 
laneous. 

Product moment r’s were computed between 
PM and WB weighted scores for the full scale 
as well as for each test and changes in the 
grades attained were also computed. The 
mean score on the PM was 43.3 (SD, 8.9) 
and for WB Verbal Scale 51.96 (SD, 11.8). 
Information (J), Comprehension (C), Digits 
(D), Arithmetic (A), Similarities (S), and 
Vocabulary (V) had mean scores of 10.8, 
11.2, 9.4, 10.6, 10.3, and 11.4, respectively. 
The r of PM with WB was .573, which rose 
to .648 when corrected for attenuation. The 
r’s of the subtests with PM were 7, .33; C, 


1An extended report of this study may be ob- 
tained without charge from Mahesh Desai, Belmont 
Hospital, Sutton, Surrey, England, or for a fee from 
the American Documentation Institute. To obtain it 
from the latter source, order Document No. 4436 
from ADI Auxiliary Publications Project, Photodu- 
plication Service, Library of Congress, Washington 
25, D. C., remitting in advance $1.25 for microfilm 
or $1.25 for photocopies. Make checks payable to 
Chief, Photoduplication Service, Library of Congress. 


47; D, 41; A, 49; S, 50; and V, .34, which 
rose to J, .37; C, .57; D, .52; A, .65; S, .62; 
and V, .38, when corrected for attenuation. A 
change of grades based on percentiles was 
found in 109 Ss, 88 of whom were higher and 
21 lower by one grade or more in WB than 
in PM. 

The over-all 7 is not as high as might be 
expected in two very good measures of g. Even 
after correction for attenuation the & is still 
.762, making E no more than 23.8. V and J 
have the lowest r’s in our sample. Part of the 
explanation for this might be in the relatively 
lower reliability of PM in psychiatric cases 
and in the fact that V and J are less vulner- 
able to age or psychiatric illness than other 
WB tests. The last fact might also in part 
explain the improvement in 88 Ss. The differ- 
ences in the structures of the two tests are 
probably very important in explaining the 
relatively low r and the change in gradings, 
PM being a measure of present efficiency and 
involving eduction of relations and corre- 
lates, WB largely measuring g through what 
it has already achieved in the past. The high- 
est correlations of A (Arithmetical reasoning) 
and S (eduction of relations) with PM might 
also be partly explained on this basis. Other 
variables which may have influenced the dis- 
parities are the effects of the sequence in 
which the tests were given, the mode of ad- 
ministration (group vs. individual), and dif- 
ferences in the heterogeneity of the tests 
which may have affected attitudes, interest, 
and concentration. 


Brief Report 
Received November 9, 1954. 
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The Relationships Among Five MMPI 
“Anxiety” Indices 


Charles Windle 


Human Research Unit No. 3, Fort Benning, Georgia 


Within the last twenty years anxiety has 
become widely recognized as a central con- 
cept in psychology (9). Introduced and popu- 
larized by psychoanalysts (3, 8), this con- 
cept has been adopted even by experimental 
psychologists to describe motivation (10, 13, 
17). 

Unfortunately, the widespread acceptance 
of the construct of anxiety is not paralleled 
by unanimity in definition. The disagree- 
ment and confusion that exist in defining 
this concept are exemplified by the variety 
of anxiety indices proposed for the MMPI. 
Five such MMPI anxiety scores have come to 
the author’s attention. 


1. Modlin observed that patients classified as hav- 
ing anxiety neuroses were similar in having Hs, D, 
and Hy as their highest MMPI scale scores. He sug- 
gested that the combined score of these three cate- 
gories be called “the anxiety score (A score)” (11, 
p. 762). Shoben, also, has used these three MMPI 
scales, the neurotic triad, as a measure of anxiety, 
arguing that “anxiety is the central factor in most 
cases of maladjustment and neurosis” (16, p. 42). 

2. Purcell et al. questioned whether the Hy scale 
is relevant to the detection of anxiety. They replaced 
the Hy with the Pt scale as one more likely to meas- 
ure “the vague fears, over-concern, and worry char- 
acteristic of an anxiety reaction” (14, p. 84). Their 
method of scoring, in which all scores less than 60 
are given zero weight, is obviously unsuitable for 
“normal” populations. The simple sum of the Hs, 
D, and Pt scales promises to be a more generally 
useful score and will be employed in the present 
study. 

3. Welsh felt that Modlin’s index overlooked two 
basic features of the anxiety profile, “the anticlinal 
relation of D to Hs and Hy, and the secondary rise 
on Pt” (22, p. 66). His proposed formula, 


Hs + D+ Hy 
3 
+[((D + Pt) — (ds + Hy)] 


Anxiety Index = 


61 


was found to follow clinical expectations when ap- 
plied to various psychiatric and nonpsychiatric 
groups. 

4. Winne proposed a 30-item scale of neuroticism 
based on a contrast between the responses of neu- 
rotic and normal veterans. Only items from the Hs, 
D, and Hy scales were used. In describing this scale 
Winne noted “the diffuse or free floating anxiety 
measured by this adaptation of the MMPI” (24, 
p. 120). It seems reasonable to assume that Winne 
conceived of this scale as a measure of anxiety 
Holtzman et al. (7) have made this same interpreta- 
tion and even used Winne’s scale to “validate” the 
Taylor anxiety scale. 

5. Taylor (19, 20) constructed a “manifest anxiety 
scale” from items which clinicians agreed were in- 
dicative of manifest anxiety. Her scale was devel- 
oped as a device for selecting experimental subjects 
hypothesized to differ in “state of reactivity or ex- 
citability, which in turn reflects their general level 
of drive (D)” (2, p. 120). Numerous studies (2, 12, 
15, 17, 18, 19, 21) have presented evidence that ex 
treme groups selected on the basis of Taylor anxiety 
scale scores differ in performance in a manner pre 
dictable from Hullian theory. 


To date, there is little evidence for pre- 
ferring any of these anxiety indices (with the 
possible exception of the Taylor scale) over 
any others, nor is there adequate evidence as 
to whether relationships found with one index 
would also be found with others. Previous 
studies (1, 4, 7) have been limited to inter- 


1As Holtzman et al. (7) have observed, the num- 
ber of items used in computing Taylor anxiety scores 
has varied considerably in different experiments 
The same appears to be true for the particular items 
used. The scores in the present study were based on 
the list of 50 items presented by Taylor (20, p. 286). 
The MMPI numbers of the items used are: 7, 13, 


14, 18, 23, 31, 32, 43, 67, 86, 107, 125, 142, 158, 163, 
186, 190, 191, 217, 230, 238, 241, 242, 263, 264, 287, 
301, 317, 321, 322, 335, 337, 340, 352, 361, 371, 397, 
407, 418, 424, 431, 439, 442, 499, 506, 523, 528, 530, 


549, 555. 
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Table 1 











Intercorrelations and Reliability of Anxiety Scores of 55 Females on Two Administrations of the MMPI 





Mean Retest 

Anxiety correla reliability 
measures Purcell’s Welsh’s Winne’s Taylor’s tion coefficient 
Modlin’s .68 (.52)* .36(.08) .35(.27) 37 (.31) 45 (.30) 80 
Purcell’s .86(.79) .54(.63) 83 (.82) .75(.71) 91 
Welsh’s 33 (.44) 74(.61) .63 (.53) 84 
Winne’s 56(.65) 45(.51) 79 
Taylor’s .66(.63) 92 

* The first coefficients are from the first test administration; the coefficients in parentheses arc from the second administration. 


relating only three of the five MMPI anxiety 
indices. In addition to their limited scope, 
these studies suffer from minor inaccuracies 
in the indices used, and from the need for 
cross validation. 

The present study proposed to determine 
the interrelationships of all five anxiety in- 
dices within a single population, incidentally 
providing an estimate of retest reliability for 
each index. 


Method 


Fifty-five female undergraduate students at 
the State University of Iowa were given the 
MMPI group form twice, with a one-week in- 
terval between tests. The subjects were given 
no explanation of why they were being either 
tested or retested, other than that these tests 
were part of an experiment, nor were they 
given their test scores. Correlations among 
the five anxiety indices proposed for the 
MMPI were computed. 


Results 


The results of intercorrelating the five anx- 
iety scales are presented in Table 1. In gen- 
eral, Purcell’s score was the most highly re- 
lated to the other anxiety indices. The highest 
single relationships appear to be between the 
Purcell index and both Welsh’s anxiety index 
and Taylor’s anxiety scale. It is noteworthy 
that these three scores also have the high- 
est retest reliability coefficients. In contrast, 
Modlin’s A score and Winne’s neuroticism 
score showed generally low relationships with 
other scales, and had relatively low retest 
reliability coefficients. Item overlap does not 
seem sufficient to account for the results of 


the study. The greatest overlap among these 
five scales is between Modlin’s A score and 
Purcell’s index, whereas the correlation be- 
tween these scales is of only intermediate 
value. 


Discussion 


Previous investigators have presented evi- 
dence both for (4, 5, 7) and against (1, 4, 5, 
23) high relationships among anxiety meas- 
ures. The present study also yields evidence 
both for and against high relationships. The 
high correlation of .74 between the Taylor 
anxiety scale and Winne’s neuroticism score 
claimed by Holtzman e¢ al. (7) was not 
completely confirmed in the present study. 
Neither Winne’s neuroticism score nor Mod- 
lin’s A score was sufficiently highly correlated 
with the other scales to assume equivalence 
among them. This conclusion appears doubly 
warranted in view of the item overlap be- 
tween indices and the elimination of changes 
within subjects over time, a usual source of 
error variance in correlational studies. 

On the other hand, higher correlations than 
have previously been claimed were found be- 
tween Purcell’s anxiety index and both Tay- 
lor’s anxiety scale and Welsh’s anxiety index. 
The magnitude of these correlations, ranging 
from .79 to .86, is high enough for the user 
to assume the equivalence of the scales in- 
volved. 

Purcell’s score was the most highly related 
to each of the other anxiety indices. It would 
appear that if there is any unitary anxiety 
factor measured by all of these scales, Pur- 
cell’s index best measures that factor. Un- 
fortunately, a factor analysis to determine 


vs 
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more accurately the relationships among these 
five anxiety measures is inappropriate be- 
cause of the considerable overlap of items 
among the different scales (6). 


Summary 


The intercorrelations among five “anxiety” 


measures from the MMPI were determined 
for both test and retest of 55 undergraduate 
females. Three of the MMPI anxiety meas- 
ures seem fairly highly interrelated, while 
two had relatively low intercorrelations. In 
all, Purcell’s index, the sum of the Hs, D, 
and Pt scales, tended to have the largest cor- 
relations with other anxiety indices. 


Received May 19, 1954. 
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Personality Correlates of Certain Religious Attitudes’ 


William E. Broen, Jr. 


University of Minnesota 


A sample of 140 university freshman males 
was selected from liberal arts college class 
lists and divided into three groups represent- 
ing three different degrees of “religiosity.” 
The criterion for the separation of these 
groups was a Religiosity Index defined as the 
sum of an individual’s standard scores on 
three Thurstone religious attitude scales: At- 
titude Toward the Bible, Attitude Toward 
God, and Attitude Toward Sunday Observ- 
ance. 

Various personality characteristics of these 
three groups were compared using the MMPI, 
and Welsh’s Anxiety Index and Internaliza- 
tion Ratio. The only significant difference was 
between the religious and nonreligious groups 
on the MMPI Pa scale with the religious 
group scoring higher. 

It was felt that the largely negative results 
might have been due to an incorrect grouping 
of persons on an impure “religiosity” con- 
tinuum, when the personality correlates of 
possible differences in emphasis upon the 


1An extended report of this study may be ob- 
tained without charge from William E. Broen, Jr., 
524 14th Ave. S. E., Minneapolis 14, Minnesota, or 
for a fee from the American Documentation Insti- 
tute. To obtain it from the latter source, order Doc- 
ument No. 4437 from ADI Auxiliary Publications 
Project, Photoduplication Service, Library of Con- 
gress, Washington 25, D. C., remitting in advance 
$1.75 for microfilm or $2.50 for photocopies. Make 
checks payable to Chief, Photoduplication Service, 
Library of Congress. 
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various aspects of religion should have been 
investigated separately. Therefore, the three 
attitude scales, each of which was felt to tap 
somewhat different aspects of religious belief, 
were correlated separately with the L scale 
and the ten clinical scales of the MMPI and 
with Welsh’s AI. Significant correlations of 
— .24 between the Attitude Toward the Bible 
scale and MMPI D, and + .20 between the 
Attitude Toward Sunday Observance scale 
and MMPI Pt were found. Both correlations 
were in the hypothesized direction. 

Corroborative evidence for the statement 
that the several aspects of religion are stressed 
differentially in the lives of various persons 
was found in the intercorrelations of the atti- 
tude scales. The Attitude Toward the Bible 
scale and the Attitude Toward God scale 
(both with a positive belief content) were 
found to correlate with each other to a much 
greater degree than either did with the Atti- 
tude Toward Sunday Observance Scale with 
its “thou shalt not” content (r = + .75 vs. 
+ 49 and + .44 respectively). The existence 
of separate “positive” and “negative” re- 
ligious factors is therefore hypothesized. 

These data suggest that factor-analytic re- 
search in this area might prove fruitful, with 
the purification of variables leading to more 
conclusive findings. 


Brief Report 
Received October 19, 1954. 


le 
ne 


ns 


nt 
ed 
ns 
ti- 
le 
ile 
re 
ch 
ti- 
ith 
vs. 
ice 
re- 


re- 
ith 
ore 


Journal of Consulting Psychology 
Vol. 19, No. 1, 198 


The Use of Demographic Characteristics in Predicting 
Response to Hospitalization for Tuberculosis’ 


Louis J. Moran, George W. Fairweather, Robert B. Morton, 
and Laurence S. McGaughran * 
VA Hospital, Houston, Texas 


Every year, almost half of all patients 
in tuberculosis hospitals leave the hospital 
against medical advice (3, 4). The prevalence 
of such discharges constitutes the greatest 
single obstacle to the control of tuberculosis 
in this country. Indeed, a recent investigation 
(3) indicates that the effectiveness of medical 
treatment for tuberculosis is now such that 
the major deterrent to success lies not in 
remedial techniques but in the inability or 
unwillingness of patients to stay for the neces- 
sary hospitalization period. 

The psychological problems of tuberculous 
patients have been the subject of much study, 
and a staggering amount of material has been 
published on “the psychology of the tuber- 
cular.” The reader is referred to Barker, 
Wright, Meyerson, and Gonick (1) for an 
exhaustive and critical 1953 review. 

With few exceptions these studies may be 
grouped roughly into three categories. The 
majority are classified by Barker et al. as 
“expert opinion.” Typically, these are ob- 
servations on psychiatric, psychological, or 


1We wish to acknowledge our indebtedness to 
Professor Trenton W. Wann, department of psy- 
chology, Rice Institute, and part-time staff member, 
Houston VA Hospital, for his contributions to the 
original formulation of the research project and for 
frequent consultations on theoretical issues during 
this study. We also wish to acknowledge the as- 
sistance given by James Hummell, department of 
mathematics, Rice Institute, in statistical consulta- 
tions. Much credit is due to Drs. Daniel E. Jenkins, 
Irving Chofnas, and Hollis G. Boren, tuberculosis 
specialists, whose guidance and support made this 
study possible. 

2 Professor L. S. McGaughran, department of psy- 
chology, University of Houston, is a part-time staff 
member, Houston VA Hospital. 
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social aspects of tuberculosis made by various 
specialists in their clinical practice. Another 
large group might be called “ad hoc explana- 
tion” studies. These usually categorize by 
frequency the probable reasons for quitting 
hospital treatment. An excellent review of 
these studies is given by Tollen (4). A third 
group might be categorized as “personality 
determinism” studies. Usually these involve 
the application of psychological tests or sys- 
tematic interviews. Some of the studies in this 
third group seek to describe general “per- 
sonality traits of the tubercular.” Others at- 
tempt to compare the personality traits of 
patients who leave against medical advice 
with those of patients who remain for defini- 
tive treatment. 


Problems of Method 


Without an attempt here to analyze the 
approaches in detail, certain general questions 
concerning methodology may be raised. These 
methodological problems are by no means 
specific to studies of the conditions under 
which some tuberculous patients quit the hos- 
pital and others stay. However, there seems 
to be a particular need in this area for a 
closer examination of (a) criteria for selection 
of subjects, (6) sampling techniques, and (c) 
isolation of relevant variables. 


Criterion. All studies designed to discriminate the 
characteristics of people who will remain for com- 
plete treatment from those who will leave before 
completion of treatment have used the administra- 
tive designation, “regular” (Maximum Hospital Bene- 
fit) vs. “irregular” (Against Medical Advice, AWOL, 
or Disciplinary) discharge as criterion for selection 
of subjects. 
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The conditions under which either of these ad- 
ministrative labels is applied are so varied, however, 
that they have little meaning as experimental cri- 
teria. For example, in the hospital under study 
here, 186 regular discharges were given in the pe- 
riod 1949-1952. Of these regular discharge patients, 
14 per cent were found not to have tuberculosis at 
all and were quickly discharged, 18 per cent were 
found to have inactive disease and discharged, 12 
per cent left “at their own risk,” 7 per cent were 
discharged while still ill after emergency treatment, 
and only 49 per cent entered with active disease and 
remained in the hospital to follow a definitive treat- 
ment program. 

Hence, an administrative regular discharge may 
include some people discharged without treatment, 
some with still active disease, some treated until 
well, and even some who leave at own risk, which 
is behaviorally equivalent to leaving “against medi- 
cal advice.” Although the irregular discharge cate- 
gory is relatively more homogeneous, it encompasses 
reactions other than leaving against medical advice, 
e.g., discharge for disciplinary reasons. 

The heterogeneity and overlap of groups sepa- 
rated in terms of this administrative criterion mili- 
tate against the discovery of psychological dimen- 
sions that might differentiate the two groups. At 
least, the complexity of such a criterion greatly com- 
plicates attempts to predict it. The development of 
a simpler definition of final response to hospitaliza- 
tion seems necessary. 

Sampling. In most studies of irregular discharge, 
sampling has been postcriterion. That is, subjects 
are selected for study after discharge. In some 
studies, a cross section of patients in the hospital 
has been tested and the data analyzed after the pa- 
tients have met the criteria of regular or irregular 
discharge. Other studies combine these sampling 
procedures. 

In an area where so little factual information is 
available, precriterion sampling seems especially im- 
portant. Actual behavior in the hospital may then 
be observed directly. The specific conditions under 
which the behavior occurs are accessible for objec- 
tive measurements. And, most important, repeated 
measurements may be taken during the course of 
hospitalization. 

If samples are selected for intensive study from 
currently hospitalized patients, a device for stratify- 
ing samples in terms of probable final discharge type 
would greatly enhance the efficiency of the design. 
It would eliminate the time period, often years, 
necessary for patients to reach the final discharge 
criterion. Comparison groups might be equated for 
size. Patients who would not eventually meet cri- 
terion could be excluded beforehand. The matching 
or equating of groups on important variables would 
be simplified. And, most important, evaluation of 
the effects of experimental intervention would be 
greatly facilitated, eg., the reduction of within- 
group variance by the use of stratified samples. 

At present, no technique is available for determin- 
ing upon admission to the hospital the probability 


of regular or irregular discharge. The development 
of such a technique for stratifying samples would 
contribute in a number of ways to intensive studies 
of the process of adaptation to hospitalization. 

Isolation of variables. The usual experimental ap- 
proach to the problem of irregular discharge relies 
on psychological tests or interviews to detect differ- 
ences in personality traits between regular and ir- 
regular discharge patients. The assumption implicit 
in these studies is that personality traits, “resident” 
in the individual, constitute the crucial determinants 
of his ultimate response (stay or quit) to hospitali- 
zation. 

It seems equally reasonable to assume that other 
factors, entirely independent of personality, may be 
just as important correlates of such behavior as the 
personality that the patient “brings with him” into 
his particular hospital environment. For example, 
two people with hypothetically identical personality 
traits but with different family constellations, differ- 
ent incomes, different stages of disease, of different 
races, etc. might follow entirely divergent paths in- 
sofar as staying in or quitting the hospital is con- 
cerned. Furthermore, patients in the same hospital 
may be adjusting to quite different objective situa- 
tions. Depending on the physical condition of the 
patient, treatment may range from simple rest to 
repeated strenuous procedures (such as months of 
periodic insertion of air into the peritoneal cavity) 
to major, disfiguring surgery. A patient may be 
painfully ill or asymptomatic, comfortably pen- 
sioned or ruined financially, rooming with a friendly 
or unfriendly patient, etc. 

The contribution of these extra-personality factors 
to the variability of response to hospitalization 
might well obscure much of the variability con- 
tributed by personality traits if the latter are treated 
independently. Isolation and systematization of ob- 
jective situational differences within the hospital and 
other such extra-personality variables, in a form 
suitable for controlled experimentation, are a logi- 
cal prerequisite to studying the conditions under 
which some patients stay for complete treatment and 
others leave against medical advice. 


The Problem 


The aims of the present study are: (a) 
specification of simple criteria for final re- 
sponse to hospitalization, and (5) the de- 
velopment of a device for selecting samples, 
on admission to the hospital, with a predicted 
final response (stay or quit) to hospitaliza- 
tion. 


Method 


The criterion for selection of subjects is 
based on a simple stay-response or quit-re- 
sponse dichotomy. Stay response: the patient 
entered with active disease and stayed until 
discharged by his physician as having re- 
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ceived adequate treatment. Quit response: 
the patient entered with active disease and 
left the hospital against the advice of his 
physician. Both groups entered ill, both groups 
began a treatment program, one group stuck 
it out, the other quit in midstream. The 
present study seeks to predict only one or 
the other of these two final responses. 

Note that this selection excludes regular 
discharge patients who left after diagnosis 
only, after emergency treatment only, or at 
their own risk. This selection eliminates 51 
per cent of the “regular discharge” sample, 
and also excludes disciplinary discharges and 
transferred or expired cases. 

Data for this study were derived from the 
clinical record folders of discharged patients. 
The clinical record folder of each patient in a 
Veterans Administration hospital contains an 
account of his medical treatment history and 
certain demographic data, e.g., age, race, oc- 
cupation. Forty such items of information 
available in the records were selected to serve 
several purposes, one of which involves pre- 
diction of final response to hospitalization. 
Information on these items was abstracted 
from the clinical records of all patients dis- 
charged from the Tuberculosis Service of a 
large General Medical and Surgical (GM&S) 
Veterans Administration hospital from March 
1949 through December 1952. 

Of this total sample, ali cases failing to 
meet the criteria of stay response or quit re- 
sponse and all cases with more than two “un- 
known” information items were excluded. 
This left a total sample of 268 discharges. 

Only 22 of the 40 information items ab- 
stracted from the clinical records are known 
at the time the patient is admitted to the 
hospital. Information on these 22 items was 
tallied for the selected stay and quit groups.* 
Cutting points were determined by inspection 
and the significance of differences between 
groups evaluated by chi square. 


8 When the item of information does not vary with 
time, e.g., race, all cases with more than one dis- 
charge from the hospital are eliminated. This is to 
prevent any one case from unduly increasing fre- 
quencies in one or perhaps both groups. If the in- 
formation does vary with time, eg., number of 
previous hospitalizations, each discharge is counted. 
Hence, for some items the sampling unit is “people,” 
and for others “discharges.” 


Results 


Of the 22 items, 9 served to differentiate 
significantly the groups. Items significant at 
least beyond the .05 level were: age on ad- 
mission, service-connected disability pension, 
duration of illness, chronic vs. fresh disease, 
number of previous hospitalizations, type of 
any previous hospital discharge, permanent 
address, psychiatric diagnosis in addition to 
tuberculosis, and occupation. 

The following items did not reach the .05 
level of significance: month of admission, day 
of admission, war service, marital status, num- 
ber of children, number of siblings, various 
combinations of diagnoses (other than neuro- 
psychiatric), time in service, religion, race, 
stage of tuberculosis (minimal, moderate, far 
advanced), and the number of readmissions 
to this hospital. 

Each of the nine significant information 
items yielded individual probability state- 
ments concerning the quit response, i.e., the 
proportion of quit responses to row totals in 
the chi-square tables. However, since these 
items did not represent independent events,‘ 
computation of the probability of quit re- 
sponse by direct combination of these in- 
dividual probabilities was not possible. Nor, 
with a sample of this size, was it possible to 
compute a probability statement that took ac- 
count of interdependent events. Therefore, no 
attempt was made to derive mathematically 
the probability of quit response by means of 
combining the individual probabilities of the 
nine items. Instead, each patient was assigned 
a score, derived from the nine items. 

A system of weighted scores was selected 
in preference to a system which assigned a 
patient an unweighted score from 0 to 9, de- 
pending on the number of high probability 
items he “hit.” On the original sample, the 
unweighted scores yielded a contingency co- 


* Let A represent the event of a quit response and 
H,, Ho,...H» the nine known hypotheses. The com- 
bined probability of any two hypotheses is: 


P(A\H;) \ { P(A|H:) 
pia) | ( P(A) )( P(A) )|. 


When this formula is applied to various pairs of hy- 
potheses as occurring in the problem under consid- 
eration, it is found that the formula gives a value 
greater than one in almost every instance. Hence, 
any hypothesis of independence must be rejected. 
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efficient with the criterion of .26, p < .001, 
with the median as cutting point, while the 
weighted scores yielded a contingency coef- 
ficient of .47, p < .001. 

Weighted scores were determined in the 
following mariner. The log was ascertained for 
every probat:ility value as derived from the 
nine significant information items. The score 
of a patient. was the sum of the nine log 
values that -applied to him. This arbitrary 
procedure setved only to accentuate the direc- 
tion of individual probability statements and 
to disperse ‘scores. The score merely places 
the subject somewhere on a scale and is not 
itself a prolability statement. However, the 
probability “f quit response for points on the 
scale may then be determined. 

Scores this computed for all cases in the 
sample ranged, with intervals of .1, from 12.3 
to 17.2. Below an arbitrary cutting point of 
15.7 were 77 cases. Of these, 89 per cent 
stayed for definitive treatment (stay re- 
sponse). Above a cutting point of 16.5 were 
57 cases. Of these, 90 per cent left against 
medical advice (quit response). This index 
served, then, to select from the total group 
sizable samples with a high probability of 
either stay response or quit response. 

Predicticn for this group of 1949-1952 
discharges was spuriously high, of course, 
since the index was constructed from the very 
cases being predicted. Therefore, the index 
was cross validated on a sample of 1953 dis- 
charges. 


Cross Validation 


The first 103 successive discharges in 1953 
who met the definition of stay response or 
quit response were selected, and the same 
scoring procedures and cutoff points employed. 
Below the cutting point of 15.7 were 21 cases, 
with 81 per cent stay response. Above 16.5 
were 32 cases, with 72 per cent quit response. 

Thus, the application of this index in 1953 
would have served to isolate from this sample 
of 103 cases a group (21 per cent) with 8 
chances in 10 of stay response and a group 
(32 per cent) with 7 chances in 10 of quit 
response.°® 


5It should be noted that these are conditional 
predictions. Predictions on current cases must be 
made only on cases with diagnosed active tubercu- 


Table 1 


Probabilities of Quit Response Given by Each of the 
Items in the Refined Form of the Index 











Proba- 
Chi bility of 
square Cutting quit 
Item N p points response 
Service-connected 360 .001 yes 75 
disability no By 
History of Tbe 348 .001 first onset §a* 
chronic case aa 
Duration ofillness 332 .001 <2months Al 


>2mo. <2yr. .60* 
>2yr.<Syr. .64 


>S5 yr. 79 

Previous hospi- 340 .001 none 43* 
talization 1 or 2 .63 
>2 85 

Previous discharges 332 .001 none §7° 
all regular 11 
all irregular 88 
mixed 64 

Residence 363 .05 same city Bn 
other .68 

Previous psychi- 352 .001 no .58* 
atric diagnoses yes 83 
Occupation 333 .01 unemployed 83 
laborer .64 
student .27 

other physical .62* 
other mental 51 





Note.—WN differs for each item because occasionally informa- 
tion on one item is “unknown” for a particular case. The 
score given in such instances is the log of the modal p value 
of that item, which is indicated here by an asterisk. 


No predictions were made for cases that 
fell between the scores 15.7 and 16.5 (49 per 
cent of sample). It should be noted, however, 
that the index was devised not to predict all 
cases on admission but to select homogeneous 
samples from the total group. When used in 
this way, with cutoff points of 15.7 and 16.5, 
the index yielded a contingency coefficient of 
48, ’ < .001, on the cross-validation sample.® 


losis. This eliminates the miscellany of administra- 
tive regular discharges that are not classified here as 
stay response. Also, the small proportion of cases 
that expire, transfer to another hospital, or receive 
a disciplinary discharge must be dropped from a 
predicted sample. 

6 All contingency coefficients reported in this study 
are derived from 2 X 2 tables; hence, the maximum 
possible C is .707. 
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Fig. 1. Distribution of scores for stay-response cases and quit-response cases on the revised index 


The Revised Index 


The final form of the index was achieved 
by combining the discharges in all five years, 
1949-1953. On cross validation the discrimi- 
nation power of all but the “age” item re- 
mained significant. Scores on the final form 
were derived from the remaining eight items 
exactly as in the original form. The indi- 
vidual probabilities furnished by each item 
are given in Table 1. 

The scores of each group distribute as 
shown in Figure 1. 

The validity of this index, i.e., the correla- 
tion between scores and stay or quit responses, 
clearly depends on the cutting points selected. 
If the index were used to attempt predictions 
on every case, the median (14.08) might be 
selected as the cutting point. The contingency 
coefficient would then be .40, p < .001. Other 
cutting points may be selected that yield 
higher validities. For example, cutting points 
of < 13.9 and > 14.1 isolate 79 per cent of 
all cases and yield a C = .50, p < .001. If 
homogeneity rather than size of sample is 
emphasized, cutting points of < 13.7 and 


> 14.5 isolate 40 per cent of all cases with 
C = .59, p< .001. The last cutting points, 
for example, isolate 39 cases with 8.5 chances 
in 10 of stay response and 103 cases with 8.8 
chances in 10 of quit response. 


Discussion 


By means of this index, samples of a given 
size and with a given probability of stay or 
quit response may be selected from the popu- 
lation entering the hospital under study. This 
fulfills the aim of the present study. 

Generalization of these results to other 
tuberculosis hospitals must, of course, await 
cross-validation studies. However, a recent 
unpublished dissertation by Speth (2), con- 
ducted independently in an eastern Veterans 
Administration hospital, suggests some likeli- 
hood of the generalized nature of these rela- 
tionships in Veterans Administration hospitals. 
In conjunction with personality measures, 
Speth also collected certain demographic data 
in an effort to differentiate regular discharge 
from irregular discharge tuberculous patients. 
As in the present study, age, race, religion, 
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number of dependents, and marital status 
were found not significant. Also in agreement 
with the present findings; service connection, 
length of illness, and previous irregular dis- 
charge were found to differentiate the groups. 

The immediate value of this index is seen 
as a device for the economical preselection of 
stratified samples for intensive study during 
the course of hospitalization. It also may be 
applied to advantage in studies of irregular 
discharge that are designed to evaluate the 
effects of experimental intervention, in that 
within-group variance may be reduced by 
using groups stratified in terms of probable 
final discharge. 

The predictive efficiency of these simple 
demographic data serves to emphasize the im- 
portance of variables other than personality 
traits as correlates of final response to hos- 
pitalization. As noted earlier, objective situa- 
tions, both within and without the hospital, 
may vary greatly from patient to patient. 
Svstematization of these variables as well 
as personality variables seems a logical pre- 
liminary to the study of adaptability to pro- 
longed hospitalization. 


Summary 


About half of all hospitalized tuberculous 
patients leave the hospital against medical 
advice. An overview of literature on this prob- 
lem suggests the need for a closer examination 





of (a) criterion for selection of subjects, (5) 
techniques of sampling, and (c) isolation of 
relevant extra-personality variables. A crite- 
rion for final response to hospitalization is 
specified and an index derived from demo- 
graphic data that may be used to predict the 
final response of select samples. On cross 
validation, this index yields a C of .48, p 
< .001, between score and final response for 
the predicted samples. A refined form of this 
index is then described and its application 
as a technique for stratifying samples for 
intensive study or for evaluating effects of 
experimental intervention is discussed. 


Received May 11, 1954. 
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Results of Treatment of Enuresis by a Conditioned 
Response Method 


Barclay Martin and Delores Kubly 


University of Wisconsin 


Several investigators have reported using 
conditioning techniques with great success in 
the treatment of enuresis. Mowrer and Mowrer 
(3) treated 30 children between three and 
thirteen years of age by this method and re- 
ported that all were cured of enuresis within 
four to eight weeks. Morgan and Witmer (2) 
successfully cured four out of five chronic 
enuretics. The fifth was discovered to have 
bladder trouble that required medical treat- 
ment. Davidson and Douglass (1) treated 20 
chronic enuretics, ages six to thirteen, and 
reported 15 to be cured and 5 to be greatly 
improved (not more than one wet bed per 
week ). 

These studies certainly suggest that this pro- 
cedure is very efficacious in stopping enuresis. 
The samples used, however, were relatively 
small, and there is a need for additional re- 
sults on larger numbers of children before the 
general effectiveness of the method can be 
assessed. It was toward this end that the fol- 
lowing data were obtained. 


Procedure 


The information was obtained by means of 
a questionnaire filled out by parents whose 
children had been treated for enuresis at home 
with a conditioning apparatus. Questionnaires 
were sent to all people who had bought this 
commercially sold apparatus between January 
1951 and July 1953. Respondents were asked 
not to put their names on the questionnaire 
in order to assure anonymity. 

The apparatus itself consists of two wire 
mesh “foil pads” separated by a piece of 

1The authors wish to express their appreciation 


to the Health Guardian Corporation for its coopera- 
tion in this study. 
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cloth. When the circuit between the foil pads 
is completed as a result of urination, a buzzer 
sounds and the child is awakened. In terms of 
conditioning theory, bladder tension is the 
conditioned stimulus, the buzzer is the un- 
conditioned stimulus, and waking up is the 
response that is to be associated with bladder 
tension. As time goes by, it is also hoped that 
the somewhat more temporally removed re- 
sponse of sphincter control will become as- 
sociated with bladder tension, thus allowing 
the child to sleep through the night dry. 

Parents who buy this equipment are re- 
quested to consult a physician before using it 
in order to rule out organic factors. 


Results 


One hundred and eighteen questionnaires 
were returned out of the 220 that had been 
sent out. Part of the information thus ob- 
tained is tabulated in Table 1. The four 
points on the improvement rating scale are 
defined as follows: 


Cure: Three recurrences or less since the end of 
treatment. 

Marked improvement: One to two recurrences per 
month since the end of treatment. 

Temporary improvement: Two to six recurrences 
per month, or intermittent dry and wet periods, or 
relapse and reusing apparatus. 

Failure: Unqualified negative reply. 


The more important results can be sum- 
marized as follows: 

1. When the Cure and Marked Improve- 
ment categories are combined, the treatment 
is found to be relatively successful in 74% 
of the reported cases. This figure must be 
accepted with some caution since it is not 
unreasonable to assume that among the 102 
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Table 1 


Results of Enuresis Treatment 


Improvement rating 


Marked 
improvement 


Cure 





Temporary 


improvement Failure Total 
N &% N % N &%&% 
| ie 17 14 118* 100 
11 14 13 16 79 ~=©100 
2 6 4 11 35 100 


Group N % N % 

Both sexes 66* 56 21 18 

Males 42 53 13 17 

Females 21 60 8 23 
* Thy N of 118 includes four Ss for whom sex was not reported. 


cases Who did not return the questionnaire, 
there fiay be a higher percentage of negative 
results Respondents, however, were told in an 
accompanying letter that the investigators 
were fist as interested in negative as positive 
result 

2. There is a significant difference between 
the sexes in terms of the occurrence of enu- 
resis. 3ixys make up 69% of the 114 cases in 
which the sex was reported, and the proba- 
bility of a chance deviation from 50% is less 
than .01. This finding is consistent with previ- 
ous findings (1, 4). 

Seventy per cent of the boys were in the 
Cure or Marked Improvement categories as 
compared with 83% of the girls, but the sex 
difference was not significant. If only those 
cases in the Cure category which report no 
recurrences are considered, the following is 
found: No recurrences are reported by 18% 
of the boys as compared with 40% of the 
girls. This difference reaches the .02 level of 
significance. 

3. The average age of the children was 9.3 
years with no significant sex differences. The 
ages ranged from 3.5 to 18.5 years. Improve- 
ment was not associated with age. 

4. The average length of treatment was 
about six weeks. For boys the average was 6.7 
weeks and for girls the average was 4.1 weeks, 
with a difference that reaches the .02 level of 
significance. The greater frequency of enure- 
sis in boys, and the tendency for girls to show 
a higher percentage of cures without recur- 
rence and to be treated for a shorter period 
of time, suggest that in general girls are less 


susceptible to enuresis and are somewhat 
more easily cured. 

5. For the cases in the Cure and Marked 
Improvement categories, an average time of 
14.5 months had elapsed since termination of 
treatment. There were no significant sex dif- 
ferences. 

6. The children had had enuresis for an 
average of six years before this treatment. 
There were no significant sex differences. 
Eighty-seven per cent of the children were 
reported to have been bed wetters since birth. 
The children were considered to have had 
enuresis only after the age of three. 


Discussion 


These results must be considered as rough 
approximations. The questionnaire approach 
prevents one from applying exactly similar 
procedures to all subjects and, in addition, 
one must rely upon the memory of the parents. 
Also, there is no control group of enuretics 
that would take into account “spontaneous” 
cures. In spite of these shortcomings, the re- 
sults indicate that this procedure is effective 
in stopping enuresis in a substantial number 
of cases. 

Conditioning or habit training procedures 
are frequently referred to by clinicians as 
being merely “symptomatic,” with the impli- 
cation that really successful and lasting cures 
for symptoms such as enuresis can only be 
achieved by more intensive therapeutic at- 
tention to underlying personality disturbances. 
In the case of enuresis the present writers 
would like to suggest the following viewpoint. 
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There is no sharp dichotomy between children 
for whom enuresis is a rather isolated habit in 
an otherwise well-adjusted personality and 
children for whom enuresis is one manifesta- 
tion of deep-seated anxiety and seriously dis- 
turbed interpersonal relations, usually in the 
family context. The alternatives probably 
represent extremes on a dimension. The greater 
the investment that the child has in the 
enuresis as an interpersonal expression—for 
example, as a passive way of expressing hos- 
tility and defiance toward the parents—the 
less likely is it that the habit training pro- 
cedures will be effective. However, the results 
of the study suggest that a substantial num- 
ber of enuretics are not so emotionally dis- 
turbed as to render these procedures ineffec- 
tive. 

Of course, it would be wise for parents to 
obtain a psychological evaluation of the child 
as well as a physical examination before using 
the conditioning apparatus. 


Summary 


The results of treating enuresis by a con- 
ditioned response method are reported in this 
study. It was found from questionnaire re- 
sponses by parents of 118 children that this 
procedure was relatively successful in 74% of 
the cases. Girls were found to have enuresis 
less frequently, and to be somewhat more 
easily cured when they did have it. 


Received May 24, 1954. 
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MMPI Responses of Patients with Multiple Sclerosis’ 


Franklin C. Shontz 
Highland View Hospital, Cleveland, Ohio 


In the present research, the Minnesota 
Multiphasic Personality Inventory was ad- 
ministered to a group of sixteen patients hos- 
pitalized for multiple sclerosis and to a group 
of sixteen patients hospitalized at the same 
institution for chronic illnesses other than 
multiple sclerosis. The groups were matched 
(by groups) for chronological age, and the 
average MMPI profiles for both samples were 
compared with each other and with the re- 
sults reported by Canter (1) in a previous 
research. 

Significant differences were found between 
the three samples (Canter’s “MS” group, and 
the present “MS” and “Other Chronic IIl- 
nesses” groups) only with respect to the Hs, 
Hy, D, and (?) variables. On both the Hs 
and Hy scales, the three groups could be 
ranked in descending order as follows: 

1. MS group from Canter’s research. 

2. MS group from present research. 

3. Other Chronic Illnesses group from pres- 
ent research. 

All differences were significant at a prob- 
ability level of .05 or less. On the D scale, 
the present group of MS patients was again 
found to obtain a significantly lower mean 
score than Canter’s subjects, but this lower 
value was not significantly different from 


1An extended report of this study may be ob- 
tained without charge from Franklin C. Shontz, 
Highland View Hospital, Cleveland 22, Ohio, or for 
a fee from the American Documentation Institute. 
To obtain it from the latter source order Docu- 
ment No. 4438 from ADI Auxiliary Publications 
Project, Photoduplication Service, Library of Con- 
gress, Washington 25, D. C., remitting in advance 
$1.25 for microfilm or $1.25 for photocopies. Make 
checks payable to Chief, Photoduplication Service, 
Library of Congress. 


that of the Other Chronic Illnesses group in 
this research. Finally, the present MS pa- 
tients were also found to produce more (?) 
responses than the Other Chronic Illnesses 
group, although differences in the adminis- 
tration of this scale made cross-study com- 
parison impossible. 

In short, the present sample of patients 
with multiple sclerosis could be differentiated 
from a sample of patients with other chronic 
illnesses by the evidence of higher levels of 
self-concern, body anxiety, and uncertainty 
of response in the former group. Both samples 
obtained about equal D scale scores. 

Despite the occurrence of certain differ- 
ences, the average MMPI profile for the pres- 
ent MS group was found to be very similar in 
fu. 1 to that obtained by Canter. The lower 
values which were obtained in this research 
on the Hs, D and Hy scales may probably be 
attributed to the higher mean age and longer 
duration of illness of the patients in the pres- 
ent study (implying more adaptation to the 
disease process itself) and to the fact that 
many of the patients used in this research 
have been permanently hospitalized for some 
time and therefore exist in a relatively secure 
and nonfrustrating environment. 

The ambiguity of the disease process itself 
is held to account for the higher level of (?) 
responses for certain individuals in the pres- 
ently tested group of patients with multiple 
sclerosis. 


Brief Report 
Received November 1, 1954. 
Reference 


1. Canter, A. H. MMPI profiles in multiple sclero- 
sis. J. consult. Psychol., 1951, 15, 253-256. 














in 


) 
es 
s- 


its 


lic 
of 


les 


pT- 
s- 


yer 
ch 
be 
yer 
es- 
‘he 
vat 


me 
ure 


self 
(?) 


ple 


ero- 








Books 


Arbuckle, Dugald S. Student personnel services in 
higher education. New York: McGraw-Hill, 
1953. Pp. x + 352. $4.75. 


In addition to the content usually found in a dis- 
cussion of personnel services, such as admission, ori- 
entation, group activities, health, student aid, and 
housing, the author has included chapters on teach- 
ing and religious services. The book is addressed to 
all faculty members and is written in an inviting, 
nonpedantic style. The chapters on counseling and 
teaching present a good summary of the basic con- 
temporary ideas about these processes in a student- 
centered framework. If a good percentage of our 
faculties would read and react to these ideas, a real 
contribution to higher education would be made. It 
is in the chapters on counseling and teaching that 
Arbuckle comes closest to solving a common prob- 
lem in the field, namely, not to lose sight of the dy- 
namic person when discussing services well planned 
for his development. The 74 pages of appendices, 
which include many blanks and specific illustrations 
of personnel activities in practice, will be helpful to 
personnel workers in the field. The reviewer feels a 
better coverage of the periodic literature could have 
been achieved without distracting from the readable 
and integrated nature of the volume—F. McK. 


Bellak, Leopold. The Thematic Apperception Test 
and the Children’s Apperception Test in clinical 
use. New York: Grune & Stratton, 1954. Pp. x 
+ 282. $6.75. 

In this clinical manual for the TAT and CAT, 
Bellak elaborates his techniques for recording and 
interpreting which have been presented more briefly 
elsewhere (see J. consult. Psychol., 1950, 14, 161; 
1952, 16, 159; 1953, 17, 156). Although he gives 
short summaries of other approaches, the author 
leans most heavily on his TAT blank, which is used 
in presenting the longer illustrative cases. An analo- 

Note.—The reviews were prepared by the Editor 
and the Advisory Editors, whc may be identified by 
their initials. 





gous form is used in the interpretation of the CAT 
protocols. References to completed research are 
minimal, but there is a short chapter outlining needed 
studies. Because the informal richness of the picture- 
story method is best revealed by studying many 
examples analyzed from varying viewpoints, this 
manual will be instructive for clinicians and stu- 
dents. It is probably not, in itself, a sufficient text- 
book in projective methods.—L. F. S. 


Brand, Howard. (Ed.) The study of personality: a 
book of readings. New York: Wiley, 1954. Pp 
xvi + 581. $6.00. 

Brand’s book of readings is a well-constructed in- 
structional tool. The selections are diverse but all 
are characterized by a high degree of relevant read- 
ability; there is hardly a dull one in the lot. The 
editor has supplied integration by general introduc- 
tions to the sections and by brief notes which pre- 
cede each article. The book will be useful for in- 
structors who like their students to read, think, and 
discuss. It will be less helpful to those who wish to 
present a systematically organized theory —L. F. S 


Burrow, Trigant. Science and man’s behavior. New 
York: Philosophical Library, 1953. Pp. xii + 564 
$6.00. 


After receiving training in both medicine and psy- 
chology, Burrow became interested in the psycho- 
analytic movement and participated in the introduc- 
tion of psychoanalysis in America. Despite the in- 
dividualistic emphasis of his training, he felt that an 
organismic point of view, which included a concern 
with the emergent characteristics of mankind as a 
social group, was necessary for the proper under- 
standing of human behavior. Burrow presented his 
views by correspondence to a number of eminent 
scientists and the present volume is inspired by this 
correspondence. Unfortunately Burrow suffered a 
fatal illness in 1950, and the present volume is an 
integration and a completion of his work prepared 
by a close associate, William E. Galt. The volume, 
which cuts across many disciplines, shows a con- 
tinuous concern with some of the destructive fea- 
tures of man’s group behavior. In its effort to get 
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the reader to view mankind with a detachment which 
the reader’s individual past scarcely permits, the 
work is most provocative. Although the reader is 
certain to be most sympathetic with Burrow’s con- 
cern for the fate of man, and respectful of the scope 
of his scholarly allusions, he is likely to find the 
reading unusually difficult. In anticipation of this, a 
quotation from the author is most noteworthy: 
“ .. it is the automatic tendency of the student 
confronted with the principles of phylobiology to 
shy away from them, and in support of his irresolute 
policy to indict my formulations as being obscure 
and unacceptable. .. .” The author provides his ir- 
resolute reader with a ten-page glossary offering not 
only new words and new concepts, but also old 
words with new meanings and old meanings with 
new words.—J. R. W. 


Eidelberg, Ludwig. An outline of a comparative pa- 
thology of the neuroses. New York: Interna- 
tional Universities Press, 1954. Pp. 263. $4.50. 


“This book is being written for advanced students 
of psychoanalysis, and should be read only by them.” 
With this admonition, and with the introductory ex- 
planation that the author proposes in this volume a 
method for the “systematic, comparative examina- 
tion of analytic material” as a substitute for quanti- 
tative measurement in psychoanalysis, one approaches 
the book with considerable interest and great ex- 
pectations. Careful reading, however, leaves one 
wondering whether the title, the preface, and the 
introduction were not intended for another book. 
Unless there is much more than meets the eye, eight 
of the nine chapters deal rather simply, systemati- 
cally, and briefly with Freudian psychology in strict 
accordance with the gospel of Freud. Even com- 
monly used and accepted terms and concepts are de- 
fined in elementary fashion. The ninth chapter epito- 
mizes even more succinctly the material summarized 
in the previous eight. Only in the last page or two is 
the “comparative” approach used. Were it not for 
the pretentious claims of the author at the outset, 
this book would be approached as an excellent sum- 
mary of the field of psychoanalysis. Much of the 
value of the book lies in the great number of short 
illustrative samples culled from the obviously rich 
psychoanalytic experience of the author —WM. K. 


Frank, Lawrence K.; Harrison, Ross; Hellersberg, 
Elisabeth; Machover, Karen; & Steiner, Meta. 
Personality development in adolescent girls. 
Monogr. Soc. Res. Child Develpm., 1951, 16, 
No. 53 (issued, 1953). Pp. 316 (paper). 


This study of the personality of adolescent girls is 
executed primarily through the group application of 
the Thematic Apperception Test, Horn-Hellersberg 
Test, Human Figure Drawings, Rorschach test, and 
graphological analysis of the TAT records. One hun- 
dred subjects were drawn from each of the follow- 
ing age ranges: prepuberal, puberal, and adolescent. 
The collaborators provide a chapter for each test in 
which they include discussions of the method of test- 
ing and of the personality qualities implied by the 


results. Despite the idiographic emphasis of the total 
work, numerous group comparisons are included. The 
latter portions of the monograph include an inter- 
pretive summary of findings, suggestions for schools 
and agencies, and an appendix which includes a sum- 
mary and discussion of the records of several indi- 
viduals from each of the age groupings—J. R. W. 


Gruenberg, Sidonie Matsner. (Ed.) The encyclopedia 
of child care and guidance. Garden City, N. Y.: 
Doubleday, 1954. Pp. 1016. $7.50. 

The Encyclopedia of Child Care and Guidance is 

a comprehensive encyclopedia covering the whole 

range of child growth and development. All areas of 

child guidance—physical, emotional, educational, cul- 
tural—are touched on. The emphasis is on practical 
handling of situations arising in daily living. It is 
well edited and has excellent cross indexing so that 
all information on a special topic is clearly indicated 
and easily found. The illustrations are attractive and 
add a light, human touch to the book. There are 
thirty chapters on such topics as “Family Life is 

Changing,” “How Children Begin to Learn,” “In- 

fancy: Off to a Good Start,” etc., all contributions 

by specialists in their areas. The articles are readable, 
simply written in nontechnical language, and reas- 
suring to parents. The reviewer has mixed feelings. 

While the book is very suggestive and helpful, it 

will have all the advantages and disadvantages of a 

family medical book. Such a book is valuable to 

parents as a source of needed information, a book to 
which they can constantly go for better understand- 
ing of daily situations. But it is not so valuable if 
it increases “self diagnosis” and allays fears so that 
there is a delay in getting professional help when 
needed. The Encyclopedia of Child Care and Guid- 
ance should, however, prove useful for all those 
working with parents and families. It is comprehen- 
sive and complete in its coverage, and the practical 
suggestions should be helpful in meeting each day’s 
problems.—B. M. L. 


Jones, Marshall R. (Ed.) Nebraska symposium on 
motivation: 1954. Volume II of the series in 
Current Theory and Research in Motivation. 
Lincoln, Nebr.: Univer. of Nebraska Press, 1954. 
Pp. x + 322. Cloth, $3.50. Paper, $3.00. 

This is the second University of Nebraska sym- 
posium on motivation held at the University on 
February 11 and 12, and April 1 and 2, 1954. I. E. 
Farber writes on anxiety as a drive state, John At- 
kinson on measuring motivation through sampling 
imaginative thought, Benbow Ritchie on the logical 
analysis of the laws of motivation, Leon Festinger 
on motivation and social behavior, George Klein on 
need and cognitive control, and Henry Nissen on 
drive as innate determinant of behavioral organiza- 
tion. The papers are scholarly and stimulating al- 
though highly diverse. No integration is achieved, 
but none is attempted. There is a lot to be said 
about motivation, and obviously a lot of it being 
said. The reading of it remains exciting—W. A. H. 





fre & 


-al 
er 
on 


La- 
al- 
aid 
ing 





New Books and Tests 77 


King, H. E. Psychomotor aspects of mental disease. 
Cambridge, Mass.: Harvard Univer. Press, 1954. 
Pp. xiv + 185. $3.50. 


A research monograph, reporting the application of 
tests of reaction time, speed of tapping, and finger 
dexterity to patients of various degrees of disturb- 
ance and to normal subjects. Schizophrenics were re- 
tarded in all functions, in degrees significantly re- 
lated to the severity of their disorders. The form of 
their practice learning curves did not, however, differ 
from that of normal persons. Psychoneurotics dif- 
fered little from the normal controls either in level 
of performance or in learning functions. The data 
suggest that the schizophrenics are about as well 
differentiated by these simple motor tests as by 
many supposedly more subtle and dynamic tech- 
niques. The implications are thought provoking—are 
we striving too hard to be subtle and overlooking 
the obvious ?—L. F. S. 


Maslow, A. H. Motivation and personality. New 
York: Harper, 1954. Pp. xiv + 411. $4.50. 


Clinical psychology, for which personality theory 
is such a central matter, could benefit from a book 
which effectively fuses the humanistic aims of a 
profession and the investigative and logical methods 
of a science. Toward this ambitious target Maslow 
directs his lance in his collection of interesting pa- 
pers. He fails, but the failure is a spectacular one in 
the tradition of Don Quixote. While tilting fruitlessly 
with the windmill of “atomism,” he suggests a num- 
ber of novel ideas for thoughtful consideration and 
vigorous further research. While revealing either a 
startling misconception or a frank distaste for al- 
most all that has passed so far for psychological sci- 
ence, he reaffirms the respect and unselfish concern 
for the dignity of others that are fundamental to 
the personal aspect of the clinician’s labor. And if 
he misunderstands the role of theory in science, it 
does not keep him from engaging in some creative 
empirical work that perceptibility presses back the 
wall of ignorance even as it violates his abstract dis- 
cussions of theory’s nature. For its brief reports of 
intriguing investigations and as humanistic litera- 
ture, the book is a delight. As an articulate integra- 
tion of the values underlying clinical practice and 
the techniques of thought and inquiry that provide 
the knowledge necessary to implement these values, 


it represents much more confusion than fusion — 
BE. J..8. 


Piaget, Jean. The construction of reality in the child. 
New York: Basic Books, 1954. Pp. xiii + 386. 
$6.00. 


This volume is one more testimonial to Piaget’s 
care in making observations and to his ingenuity in 
organizing and interpreting them. He here raises the 
question of how the child comes to “know” his uni- 
verse, in the sense of attaining concepts of objects, 
of space, of time, and of causality. For most of the 
studies, his subjects were his own children as they 
behaved during the first eighteen months of their 
lives. His observations of their behavior were based 


partly on simple but well-controlled stimulus situa- 
tions (finding a hidden toy, for example), partly on 
spontaneous reactions (watching persons come and 
go, for example). Because of their painstaking and 
detailed character, these observations provide badly 
needed information regarding the stages of develop- 
ment in early infancy. One cannot help noting, how- 
ever, the absence of statements concerning needs, 
motives, or social situations. To many contemporary 
child psychologists, accustomed to interpreting early 
development in dynamic terms, this may seem a 
serious shortcoming. To others, not committed to a 
particular theoretical view, Piaget’s strict adherence 
to observable behavior may seem a refreshing change 
No psychologist interested in behavior development 
can help being stimulated by the observations re- 
ported here. Many will also sense from Piaget’s con- 
ceptualization of his data a need for rethinking some 
of our dynamic hypotheses regarding infancy — 
A. M. G. 


Rogers, Carl R., & Dymond, Rosalind F. (Eds.) Psy- 
chotherapy and personality change. Chicago: 
Univer. of Chicago Press, 1954. Pp. x + 447. 
$6.00. 

Books about psychotherapy fall, by and large, into 
two classes: summations of clinical experience and 
general theoretical discussions. In either case, they 
vary considerably with respect to both sophistication 
and degree of relationship to evidence. This work, a 
product of the University of Chicago Counseling 
Center staff, is, therefore, without precedent; it is a 
whole book of research studies in the therapeutic 
process and its outcomes. Eleven chapters are de- 
voted to reports of empirical investigations of a 
controlled sort, and two are concerned with search- 
ing case analyses, methodologically unique in their 
reliance on quantified techniques and objective data 
For its boldness of conception, the enterprise and 
devotion to explicit knowledge that it reflects, and 
its uniqueness as the only volume concerned entirely 
with empirical inquiries into the events of psycho- 
therapy, Psychotherapy and Personality Change com- 
mands respect and deserves a wide and attentive 
audience. Between the lines, however, it constitutes 
a casebook in the frustrations and difficulties attend- 
ant upon research in this field. Lost cases, spoiled 
records, and a multiplicity of wild variables lurk 
like bogeymen in the background, raising questions 
about the suitability of data and marring the pre- 
cision of tests. Too, the techniques of data analysis 
will not prove as convincing or appropriate to many 
readers as they apparently did to the participants 
in this investigation. Finally, the edge of novelty 
seems to have worn off the Chicago group’s con- 
tributions. The studies reported here bear a disap- 
pointing degree of similarity to those published 
previously from this fertile source. One wonders if 
the concepts and basic ideas of client-centered coun- 
seling are not in need of a revision now that they 
have served their stimulating purpose. But no one 
else has done anything to challenge so wholesomely 
our thinking about therapy, to provide sounder in- 
formation about what happens in the consulting 
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room, or to offer a more constructive model for 
those who would replace intuition with communi- 
cable knowledge.—&. J. S. 


Stanton, Alfred H., & Schwartz, Morris S. The men- 
tal hospital. New York: Basic Books, 1954. Pp. 
xx + 492. $7.50. 


In this volume, social psychology takes a pene- 
trating look at the structure and functioning of a 
mental hospital and comes forth with some insight- 
ful conclusions. The hospital, like other social insti- 
tutions, has both a formal structure shown by its 
organization chart and an informal structure through 
which communications really pass. In many respects, 
the problems resemble those of a business or a uni- 
versity—the perceptions and misperceptions of “the 
front office” by the lower echelons of staff provide 
an example. Other issues are unique to the hospital. 
The study considers the patients as active partici- 
pants in the social organization, not merely as pas- 
sive recipients of the staff's efforts. Of special inter- 
est is the evidence of an intimate relationship be- 
tween the staff's morale and the patients’ behavior. 
The study deserves the attention of both clinical and 
social psychologists —L. F. S. 


Taylor, William S. Notehand for psychologists. (3rd 
Ed.) Northampton, Mass. (15 Pierce Hall, Smith 
College): Author, 1954. Pp. 5 (mimeographed). 
21¢. 

Syss V shorthnd wr devpd as early as t Ist cen- 
tury V our era; & syss V notehnd, whi is Is techcl, 
mu earir. Bo syss save ti & energy. Few ps, howev, 


k shorthnd; & any shorthnd n dn b an xpert cn b 
rd o b t id. who wrote it & sn bems “cold” f hm. 
Availbl now is a sys V notehnd whi is easly Irnd. It 
is designd primarly f pen or pencl notes, drafts V 


ltrs & MSS, etc., yt mst V it cn b typd. It reduces 
t ® V chars i ordinary matl abo 30%, & psll matl, 
35%. T sys is presentd i 5 mimeogrd pp. & cs. r 
availbl at approx cost. Send name, address, & 21¢ i 
stamps f ea c. to au—L. F. S. & W. S. T. 


Tests 


Langmuir, Charles R. Oral Directions Test. Person- 
nel Tests for Industry, ODT, Form S. Adults in 
industry. 1 form. (15) min. Record, 12 in., 33 
r. p. m., or tape, 300 ft., 3.75 in./sec. ($12.00 
with manual, key, 100 answer sheets); answer 

($4.00 per 100); manual, pp. 8 (35¢). 

New York: Psychological Corp., 1954. 


sheet 


A revised abbreviation of a test first published in 
1946, the Oral Directions Test provides an appraisal 
of mental ability for industrial applicants that is 
relatively independent of reading skill. Examinees 
listen to a recording and mark an answer sheet to 
show their comprehension of directions. Corrected 
split-half reliability is about 87; the test correlates 
85 with a conventional printed test. The manual 
gives preliminary evidence of discriminating above 
average and below average workers in industry, and 
provides tentative norms based mainly on textile 
and pharmaceutical employees.—L. F. S. 


Manson, Morse P., & Ulett, George A. The Ror- 
schach Evalograph. Record and analysis blank 
for Rorschach, pp. 24 ($3.50 per 10; $7.00 per 
25; $25.00 per 100). Beverly Hills, Calif. (Box 


775): Western Psychological Services, 1954. 


Perhaps the most elaborate Rorschach blank so 
far devised, the Evalograph provides spaces for re- 
cording, scoring, and tabulating responses, color- 
printed miniature blots for locations, a summary 
and profile, and numerous aids to the examiner. It 
is an attractive and compulsively thorough product, 
a dream record to end all records, -but one may 
properly question its economy. The recording and 
scoring can probably be done as effectively on less 
costly paper. The percentage table, the list of sym- 
bols, and the hints on scoring and interpretation be- 
long in a manual, not in an expendable blank. The 
Evalograph is fun if you can afford it—L. F. S. 
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